Data Engineering Lead

2 days ago

India beBeeDataEngineering Full time US$ 90,000 - US$ 1,20,000
Senior Data Engineering Leader

We are seeking a talented Senior Data Engineering Leader to design, develop, and govern our data architecture and pipelines. The ideal candidate will have experience with multiple projects that involve GCP-Big Query, Data Proc technologies.

The successful candidate will need to be collaborative, organised, think out-of-the-box, and be ready to pursue new opportunities. Most importantly, this role is for an individual who is passionate about making a difference through healthcare.

Main Responsibilities:
  • Design and implement scalable and robust data architectures for data warehousing and enterprise data platforms.
  • Develop and optimize data pipelines and ETL/ELT/CDC (Change Data Capture) workflows using tools such as Fivetran and Cloud Composer.
  • Collaborate with data scientists, product managers, and business stakeholders to define data requirements and create logical and physical data models.
  • Manage and administer various database systems, including BigQuery, SAP HANA, and PostgreSQL.
  • Ensure data quality, integrity, and security across all data platforms and pipelines.
  • Work with our AI/ML teams to design data serving layers and feature stores that support Vertex AI workloads.
  • Design and develop reporting frameworks and data marts to support business intelligence needs.
  • Integrate data platforms with various enterprise systems (CRMs, ERPs) and third-party APIs.
  • Define and implement data governance, master data management, and data cataloging strategies.
  • Contribute to the full data lifecycle: requirements gathering, architecture, data modeling, development, testing, and deployment.
  • Troubleshoot and resolve data platform issues to ensure high availability and optimal performance.
Key Qualifications:
  • Bachelor's or Master's degree in Computer Science, Software Engineering, Data Science, or a related field.
  • Proficiency in one or more backend languages/frameworks, with a strong preference for Python or Go.
  • Experience with building RESTful APIs and designing microservices for data delivery.
  • Solid grasp of data modeling fundamentals, including Kimball and Inmon methodologies.
  • Proficiency in writing complex SQL queries and experience with SQL and NoSQL databases.
  • Familiarity with data warehousing concepts and best practices, including CDC.
  • Strong version-control habits (Git) and experience with CI/CD pipelines.
  • Excellent problem-solving, communication, and collaboration skills.
Preferred Qualifications:
  • Hands-on experience designing and deploying production-grade data warehouses.
  • Deep experience with Google Cloud Platform (GCP): BigQuery for large-scale analytical workloads, Cloud Composer for orchestrating complex data pipelines, Vertex AI for AI/ML model serving and feature stores.
  • Experience with other cloud providers (AWS, Azure) and their data services.
  • Working knowledge of data governance frameworks, master data management, and data cataloging tools.
  • Experience with data ingestion tools like Fivetran.
  • Business-intelligence expertise in building dashboards and reports with Power BI or Tableau.
  • Familiarity with other data technologies such as SAP HANA.
  • Understanding of MLOps concepts and their application to data pipelines.

  • Senior Data Engineer

    3 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Gcp Data Engineer Lead

    4 weeks ago

    India CIEL HR Full time

    Hi Greetings of the Day We have a critical opening with our client for GCP Data Engineer Lead role for Pan India location Experience 6 to 10 yrs Location Pan India bangalore chennai mumbai pune chandigarh ahmedabad Delhi Nagpur Hybrid - WFO Payroll Company Name Leading MNC firm Mode of Employment perm Job description ...

  • Lead Blockchain Data Engineer

    3 weeks ago

    India Paywaz Full time

    Role: Lead Blockchain Data Engineer & Market IntelligenceCompany: Paywaz.com LLC (Business Unit: PZ Coins – Crypto Copy Trading & DEX Intelligence Platform)Compensation: Equity only (no salary until profitability)About PZ CoinsPZ Coins (www.pzcoins.com) is building the next-generation crypto copy trading and ghost trading platform, powered by structured...

  • Lead Data Engineer

    3 weeks ago

    India Rackspace Technology Full time

    Lead Data EngineerREQUIREMENTSDemonstrate knowledge and real-world experience on Big data technologies A successful history of handling performance issues processing extracting issues and fixing bugs xc2xb7 Experience managing and optimizing big data data pipelines architectures and data sets xc2xb7 We are looking for a candidate with 7 years of...

  • Lead Data Engineering Position

    1 day ago

    India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are looking for an experienced Senior Data Engineer to lead our data engineering efforts.Key ResponsibilitiesDesign and Develop Data PipelinesCollaborate with cross-functional teams to drive data-driven decision making.Implement and Optimize Data WorkflowsDevelop scalable and maintainable code using Azure and Databricks.Stay up-to-date with the latest...

  • Lead Azure Data Engineer

    24 hours ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a dynamic...

  • Lead Engineer

    4 weeks ago

    India Johnson & Johnson Full time

    At Johnson Johnson we believe health is everything Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented treated and cured where treatments are smarter and less invasive and solutions are personal Through our expertise in Innovative Medicine and MedTech we are uniquely positioned to innovate across...

  • Senior Data Engineering Lead

    2 hours ago

    India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the Role:As a seasoned Data Engineer, you will be instrumental in designing and implementing scalable ETL/data pipelines using Python and Luigi for data processing.Key Responsibilities:- Develop and maintain large-scale data processing systems using Python and related tools- Collaborate with cross-functional teams to resolve complex data engineering...

  • Lead Engineer

    4 hours ago

    India Fold Health Full time

    Job DescriptionRole OverviewWe are looking for a Lead Engineer who will play a key role in designing, building, and scaling Fold Healths healthcare platform. The ideal candidate will be a hands-on technologist with strong leadership skills, capable of guiding engineering teams, setting best practices, and driving the delivery of high-quality, scalable...

  • Data Engineer

    3 weeks ago

    India BL Consultants Full time

    We're Hiring | Data EngineersLooking for an exciting role where you can build, scale, and innovate?We're hiring for one of our clients and are on the lookout for Data Engineers (1–3 yrs) and Sr. / Lead Data Engineers (3–9 yrs) with strong hands-on experience in:- Databricks | SQL | PySpark | Python- Strong knowledge of Spark, Delta Lake, and Data...