Expert Data Pipeline Engineer

3 days ago


Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Job Title: Expert Data Pipeline Engineer

About the Role

We are seeking an experienced Data Engineer to craft and maintain robust data pipelines, ensuring efficient extraction, transformation, and loading (ETL) of data.

Key Responsibilities:
  • Design, develop, and implement scalable data pipelines using Python and SQL.
  • Collaborate with teams to integrate machine learning models into data pipelines for enhanced data processing.
  • Implement and work with Spark and Kafka for real-time data processing and analytics.
Requirements

To be successful in this role, you will need:

  • A minimum of 5 years of experience in data engineering.
  • Proficiency in Python, SQL, and database management.
  • Experience with cloud services such as MS Azure and GCP.

Additional Requirements:

  • Proven problem-solving skills and excellent communication skills.
  • Strong business acumen and adaptability in a dynamic environment.


  • Pune, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Senior Data Engineer - AWS ExpertWe are seeking a seasoned professional to spearhead the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure.Key Responsibilities:Design scalable data processing workflows using Apache Spark and SQL for analytics and reporting requirements.Build and maintain orchestration workflows to...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,30,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. As a critical member of our AI-powered applications, you will design and build scalable data pipelines that process clinical encounter data.You will work closely with software engineers, machine learning specialists, and our clinical partners to bring our...


  • Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering ExpertWe are seeking an experienced Data Engineering Expert to join our team.The ideal candidate will have a deep understanding of data engineering principles and practices, with expertise in designing and implementing robust data pipelines using Databricks, PySpark, and SQL.This role requires the ability to work independently in...


  • Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 24,50,000

    Job Title: Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert with extensive experience in designing, building, and optimizing data pipelines and ETL processes in Azure Databricks.The ideal candidate will have a strong background in SQL, Python, and PySpark, as well as a solid understanding of delta tables, Apache Spark, and Unity...

  • Data + AI Pipeline

    4 hours ago


    Pune, Maharashtra, India VME Vhire Solutions Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    You will be a key member of the Data + AI Pipeline team, leading to the integration ofKubeflow, Kubernetes, Docker, Keda, and Python technologies. Your role will involvedeveloping and maintaining AI pipelines that support various projects, ensuring seamlessand efficient data processing, model training, and deployment. As part of a dynamic...


  • Pune, Maharashtra, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: Data Engineering SpecialistThis is an exciting opportunity to join a team of talented professionals in designing and implementing data pipelines and workflows using Snowflake and Matillion.The successful candidate will be responsible for collaborating with cross-functional teams to gather requirements, define data models, and develop solutions...


  • Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,20,00,000

    Data Engineering Expert WantedWe are seeking a skilled Data Engineer to join our engineering team for an international enterprise.This is a 6-month full-time contract opportunity that requires the candidate to have strong expertise in data engineering and experience with Palantir Foundry, PySpark, and TypeScript.Palantir Foundry /...


  • Pune, Maharashtra, India beBeeAutomation Full time ₹ 9,00,000 - ₹ 12,00,000

    We are seeking a skilled Data Pipeline Automation Specialist to join our team. The ideal candidate will have extensive experience in designing, developing and maintaining automated testing frameworks for large-scale data pipelines.The successful candidate will be responsible for ensuring the stability and quality of our data pipeline solutions.This is an...


  • Pune, Maharashtra, India Mars Data Insights Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...


  • Pune, Maharashtra, India beBeeExpert Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewThe role of a Data Engineering Expert involves designing, building, and maintaining large-scale data systems. This position requires expertise in Apache Kafka and the AWS data stack, as well as proficiency in coding languages such as Python, SQL, and Java.Key Responsibilities:Develop and maintain real-time data pipelines using Apache Kafka and...