Senior Data Pipeline Developer

5 days ago


Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,75,00,000
Job Opportunity: Data Engineer

Mumbai is home to a thriving data engineering community, and we are seeking an experienced professional to join our team.

We are looking for a skilled Data Engineer with expertise in designing, developing, and maintaining batch and streaming data pipelines using PySpark. The ideal candidate will have hands-on experience in building scalable data pipelines and proficiency in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic.

  • Strong Experience in PySpark: You should have extensive knowledge of PySpark and its applications in data engineering.
  • Hands-on Expertise in Building Scalable Data Pipelines: Our ideal candidate will have hands-on experience in building scalable data pipelines using PySpark.
  • Proficiency in Using Spark SQL, DataFrame, and RDD APIs: You should be proficient in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic.
  • Programming Skills: Strong programming skills, preferably in Python, with solid coding skills in data structures, algorithms, and software engineering principles.

Bonus Skills:

  • Familiarity with Cloud Data Platform: Experience working with cloud services such as AWS S3, AWS Glue/EMR, and Redshift or other cloud data warehouses.
  • Experience with Modern Data Engineering Ecosystem: Familiarity with the current data engineering landscape, including distributed data processing, storage systems, and workflow orchestration tools.

About This Job:

This is a fantastic opportunity for you to work on exciting projects that impact the business. We offer a challenging and dynamic environment where you can grow professionally and personally.



  • Madurai, Tamil Nadu, India beBeeTesting Full time ₹ 10,00,000 - ₹ 15,00,000

    Senior Test Lead JobWe are seeking an experienced Senior Test Engineer to drive the testing strategy and execution for a project.The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management.Drive testing strategy and execution for data pipeline projectsTest data pipelines using...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a highly skilled Data Engineer to design, develop and maintain scalable data pipelines and ETL processes using GCP services.Data Pipeline Design and Development: Utilize GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer, Cloud Function, and Cloud Run to create efficient and scalable data...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Data Engineer PositionJob Overview:We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data. The ideal candidate will have a strong background in data engineering, cloud technologies, and data architecture, and will collaborate...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 18,00,000

    Unlock Your Potential in Data EngineeringTransform your career with a Data Engineer role that drives business success.As a critical member of our data engineering team, you will design, build, and manage scalable data pipelines and enterprise data solutions to support analytics, reporting, and data science initiatives. This high-impact role requires deep...


  • Madurai, Tamil Nadu, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Description:We are seeking a skilled professional to develop and maintain data pipelines, design data models, and automate reporting workflows.Data Pipeline Development: Develop data pipelines connecting Aurora MySQL → Redshift Serverless → S3/QuickSight.Data Modeling: Design data models, materialized views, and APIs for fast reporting and...


  • Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering RoleJob Description:We are seeking an experienced data professional to lead the design, development, and maintenance of ETL/ELT data pipelines. These pipelines will ingest data from various sources into our data warehouse.The ideal candidate will have:Proven experience as a Data Engineer or in a similar role.Strong proficiency in SQL...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 35,00,000 - ₹ 45,00,000

    Key Responsibilities:Develop and maintain data pipelines and ETL processes using Databricks.Lead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with stakeholders to deliver actionable data insights.Optimize data workflows for performance, efficiency, and reliability.Integrate data from multiple...


  • Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Data Engineering PositionWe are seeking an accomplished Data Engineer to play a pivotal role in designing, developing, and maintaining efficient ETL processes using Databricks PySpark. This includes extracting, transforming, and loading data from various sources into our data lake and warehouse.Key Responsibilities:ETL Development:Design and develop ETL...


  • Madurai, Tamil Nadu, India CodeVyasa Full time

    Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 10+ yrs. of experience.About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+...


  • Madurai, Tamil Nadu, India beBeeSoftware Full time ₹ 50,00,000 - ₹ 70,00,000

    Unlocking Transportation Innovation with AI-Driven SoftwareWe are seeking a Senior Full Stack Software Development Engineer (SDE) to help build cutting-edge software and data infrastructure for an AI-driven platform.About the RoleDesign and develop full stack applications using Python, Streamlit, and modern web frameworks to power internal tools, analytics...