Data Engineer Lead

2 weeks ago

Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Profile - Data Engineer Lead

Exp- 7+ Years

Location - Noida

Work Mode - Hybrid

Skills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousing

for applying you can share your CV on

Key Responsibilities

Data Engineering & Pipeline Development:

·      Develop and maintain robust, scalable ETL pipelines to ingest, clean, and transform public (e.g., CMS, Medicaid), private (e.g., commercial claims, EHRs), and purchased (e.g., Clarivate, Doceree) datasets.

  • Optimize data workflows and storage solutions to enhance data accessibility and usability for analytics and business intelligence teams.
  • Implement data quality frameworks, ensuring the integrity and accuracy of healthcare datasets used for decision-making.
  • Collaborate with data architects to design and enhance data models, ensuring efficient query performance and integration across multiple sources.

Collaboration with External Vendors & Partners:

  • Work closely with external data vendors, research organizations, and commercial agencies to define projects, ensure data consistency, and improve ingestion processes.
  • Provide technical oversight on vendor-sourced data projects, ensuring compliance with Avalere's data quality and governance standards.
  • Support the evaluation and acquisition of new datasets, integrating them into Avalere's data ecosystem for analytics and modeling.

Internal Team Leadership & Support:

  • Partner with data scientists, analysts, and market access teams to develop data solutions that drive business insights.
  • Provide technical mentorship to junior data engineers, ensuring best practices in data pipeline development, automation, and cloud-based infrastructure.
  • Work cross-functionally with data architects and analytics teams to align data engineering efforts with business and research objectives.

Required Skills and Experience

Education:

  • Bachelor's degree in computer science, information systems, data engineering, or a related field. Master's degree preferred.

Technical Expertise:

  • Extensive experience in building and managing ETL pipelines for large-scale healthcare data processing.
  • Strong knowledge of public healthcare datasets, including Medicare/Medicaid claims, state health registries, and government-funded research data.
  • Experience with private-sector datasets, such as commercial claims, EHRs, and provider-generated data.
  • Proficiency in SQL, Python, and Spark for large-scale data processing and transformation.
  • Hands-on experience with cloud platforms (AWS, Azure, GCP) and big data technologies (Databricks, Snowflake, Hadoop).
  • Deep understanding of data modeling, data warehousing, and governance best practices.
  • Experience implementing data security and compliance frameworks, including HIPAA, HITRUST, and other healthcare regulations.

Professional Experience:

  • 8+ years of experience in data engineering, pipeline development, or a related field, preferably within healthcare, consulting, or analytics.
  • Demonstrated ability to integrate, process, and optimize multi-source datasets for analytics and research applications.
  • Experience managing data acquisition projects and working with external vendors to refine data ingestion approaches.

Proven track record in developing scalable cloud-based data solutions for enterprise-wide use.

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India 3Pillar Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Embark on an exciting journey into the realm of software product development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a...

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India LUMIQ Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Who we are:LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers...

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India CGvak Software Exports Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks)Remark - final round will be the F2FExperience: 10+ Years (Lead Role)Responsibilities:Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform.Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data...

  • Data Lead

    1 week ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We're looking for a hands-on Data Lead to architect and deliver end-to-end data features that power our booking and content management systems. You'll lead a team, own the data pipeline lifecycle, and play a critical role in shaping and scaling our data infrastructure — spanning batch, real-time, and NoSQL environments.ShyftLabs is a...

  • Data - Lead

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Posted On: 8 Oct 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...

  • Lead Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Conduent Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Overview  We are looking for a Data Engineer who will be part of our Analytics Practice and will be expected to actively work in a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project; its primary responsibility is the...

  • Lead Python Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Algoworks Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Lead Python Data Engineer - Databricks (Unity Catalog, Delta, CI/CD) Job SummaryWe are seeking a highly skilled Data Engineer with a strong background in Databricks and a passion for data engineering. The ideal candidate will have extensive experience in designing and implementing data solutions using various technologies, including PySpark, Spark SQL, and...

  • Systems Engineering Specialist Advisor

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    SCCM Administration: Lead the configuration, deployment, and maintenance of SCCM infrastructure. Manage software distribution, patch management, OS deployment, and compliance settings. Monitor and troubleshoot SCCM client health and performance. Design and implement mobile device management (MDM) and mobile application management (MAM) strategies using...

  • Lead Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Unicorn Workforce Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleWe are looking for an experiencedLead Data Engineerto design, build, and optimize cloud-native data platforms on AWS. You will lead a team of Data Engineers and drive end-to-end development of scalable data pipelines, modern data architectures, and enterprise-grade data solutions for BFSI customers.This is a hands-on role with strong ownership...

  • Salesforce Vlocity Lead developer

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Lead Consultant to join our team in Noida, Uttar Pradesh, India. Once You Are Here, You Will:Perform development,...