Data Engineering Lead

3 days ago

erode, India beBeeDataEngineering Full time

Job Title Senior Data Engineer. About the Role We are building the future of healthcare analytics. Our goal is to create pipelines that are reliable, observable, and continuously improving in production. This is a fully remote role open to candidates based in Europe or India with periodic team gatherings in Mountain View California. The ideal candidate will be responsible for designing, building, and maintaining scalable ETL pipelines using Python, Pandas, PySpark, and SQL orchestrated with Airflow MWAA. The successful candidate will also develop and maintain the SAIVA Data Lake/Lakehouse on AWS ensuring quality, governance, scalability, and accessibility. Additionally, they will run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS. They will implement batch and streaming ingestion frameworks, APIs, databases, files, event streams, enforce validation and quality checks to ensure reliable analytics and ML readiness, monitor and troubleshoot pipelines with CloudWatch integrating observability tools like Grafana Prometheus or Datadog, automate infrastructure provisioning with Terraform following AWS best practices, manage SQL Server PostgreSQL and Snowflake integrations into the Lakehouse, participate in an on-call rotation to support pipeline health and resolve incidents quickly, and write production-grade code and contribute to design/code reviews and engineering best practices.

  • GCP Lead Data Engineer

    4 weeks ago

    Erode, India People Prime Worldwide Full time

    Lead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support....

  • Data Engineering Lead

    5 days ago

    erode, India beBeeDataEngineer Full time

    Job Overview:We are seeking a highly skilled Data Engineer to join our team.The ideal candidate will have experience with GCP – BigQuery, Cloud Storage, SQL, and Power BI. They will be responsible for migrating reporting data sources from Teradata to Cerebro (BigQuery), repointing and validating existing Power BI reports to new BigQuery data models,...

  • Lead Data Engineer

    5 days ago

    erode, India beBeeDataEngineer Full time

    Technical Advocate RoleThis role requires a customer-facing data engineer who can work collaboratively with multifunctional teams to implement data pipelines and integrations, and handle client expectations while working on complex technical issues under pressure.You will be the primary technical contact for customers, working closely with them to deliver on...

  • Lead Data Pipeline Architect

    5 days ago

    erode, India beBeeDataEngineer Full time

    Job OverviewWe seek a Senior Data Engineer to lead our team in designing, building, and maintaining the data pipelines that power large language model development.The ideal candidate will have 8+ years of professional experience in data engineering, data processing, or backend software engineering, and expert-level proficiency in Python and its data...

  • High-Impact Technical Lead

    6 days ago

    erode, India beBeeDataEngineering Full time

    Job TitleA high-impact Technical Lead - Data Engineering role is available for a skilled professional to design and implement scalable data pipelines in AWS.The ideal candidate will have experience with NextFlow, strong proficiency in Python, and knowledge of image processing workflows and ML model deployment.Key Responsibilities:Targeted enhancements to...

  • Chief Data Engineer

    4 days ago

    erode, India beBeeDataEngineering Full time

    Enterprise Data Engineering Leadership OpportunityWe are seeking a skilled data engineer to lead the design, development and optimization of enterprise-grade data pipelines in Microsoft Fabric and Azure Data Factory (ADF).Key responsibilities include designing, developing, and optimizing metadata-driven data pipelines for ingestion, transformation, and...

  • Data Scientist Project Lead

    4 days ago

    erode, India beBeeTechnical Full time

    Project Lead - Data ScienceThis role is for an experienced Technical Project Manager to oversee and deliver projects in data engineering, analytics, and science.Develop and implement project plans, timelines, resource allocations, and risk mitigation strategies to meet organizational objectives.Demonstrate a solid understanding of data pipelines, ETL/ELT,...

  • Data Engineering Project Leader

    6 days ago

    erode, India beBeeProjectLead Full time

    As a Technical Project Lead in Data Engineering, you will be responsible for delivering projects efficiently and effectively.Deliver technical projects on time, within scope, and with high quality.Strong understanding of data pipelines, ETL/ELT, and analytics workflows is required.Collaborate with engineering, product, QA, and operations teams to define...

  • AI Engineering Lead

    5 days ago

    erode, India beBeeGenerative Full time

    AI Engineering LeadAn experienced AI engineering lead with deep expertise in Generative AI, Large Language Models, and Big Data technologies is required.Main Responsibilities:Achieve strategic business objectives through the development of innovative AI-driven systems focusing on Generative AI technologies and Large Language Models.Key Deliverables:Define...

  • Data Engineer

    5 days ago

    erode, India beBeeDataEngineering Full time

    Job Title: Data Engineering ManagerThis is a senior-level position responsible for leading data engineering teams and overseeing the development of scalable data pipelines.