Data Engineer Lead

1 week ago

Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Profile - Data Engineer Lead

Exp- 7+ Years

Location - Noida

Work Mode - Hybrid

Skills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousing

for applying you can share your CV on

Key Responsibilities

Data Engineering & Pipeline Development:

·      Develop and maintain robust, scalable ETL pipelines to ingest, clean, and transform public (e.g., CMS, Medicaid), private (e.g., commercial claims, EHRs), and purchased (e.g., Clarivate, Doceree) datasets.

  • Optimize data workflows and storage solutions to enhance data accessibility and usability for analytics and business intelligence teams.
  • Implement data quality frameworks, ensuring the integrity and accuracy of healthcare datasets used for decision-making.
  • Collaborate with data architects to design and enhance data models, ensuring efficient query performance and integration across multiple sources.

Collaboration with External Vendors & Partners:

  • Work closely with external data vendors, research organizations, and commercial agencies to define projects, ensure data consistency, and improve ingestion processes.
  • Provide technical oversight on vendor-sourced data projects, ensuring compliance with Avalere's data quality and governance standards.
  • Support the evaluation and acquisition of new datasets, integrating them into Avalere's data ecosystem for analytics and modeling.

Internal Team Leadership & Support:

  • Partner with data scientists, analysts, and market access teams to develop data solutions that drive business insights.
  • Provide technical mentorship to junior data engineers, ensuring best practices in data pipeline development, automation, and cloud-based infrastructure.
  • Work cross-functionally with data architects and analytics teams to align data engineering efforts with business and research objectives.

Required Skills and Experience

Education:

  • Bachelor's degree in computer science, information systems, data engineering, or a related field. Master's degree preferred.

Technical Expertise:

  • Extensive experience in building and managing ETL pipelines for large-scale healthcare data processing.
  • Strong knowledge of public healthcare datasets, including Medicare/Medicaid claims, state health registries, and government-funded research data.
  • Experience with private-sector datasets, such as commercial claims, EHRs, and provider-generated data.
  • Proficiency in SQL, Python, and Spark for large-scale data processing and transformation.
  • Hands-on experience with cloud platforms (AWS, Azure, GCP) and big data technologies (Databricks, Snowflake, Hadoop).
  • Deep understanding of data modeling, data warehousing, and governance best practices.
  • Experience implementing data security and compliance frameworks, including HIPAA, HITRUST, and other healthcare regulations.

Professional Experience:

  • 8+ years of experience in data engineering, pipeline development, or a related field, preferably within healthcare, consulting, or analytics.
  • Demonstrated ability to integrate, process, and optimize multi-source datasets for analytics and research applications.
  • Experience managing data acquisition projects and working with external vendors to refine data ingestion approaches.

Proven track record in developing scalable cloud-based data solutions for enterprise-wide use.

  • Lead Data Engineer

    1 day ago

    Noida, Uttar Pradesh, India Dmi Innovations Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Lead Data Engineer - Operations is responsible for ensuring the day-to-day operations of the data platforms run smoothly. This role will be the primary interface with the management team and will work cross functionally with various IT functions to streamline operations focusing primarily on common ITIL processes (incident, request, problem, and...

  • Data Lead

    1 week ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We're looking for a hands-on Data Lead to architect and deliver end-to-end data features that power our booking and content management systems. You'll lead a team, own the data pipeline lifecycle, and play a critical role in shaping and scaling our data infrastructure — spanning batch, real-time, and NoSQL environments.ShyftLabs is a...

  • Data - Lead

    1 day ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Posted On: 8 Oct 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...

  • Lead Data Engineer- Python

    1 week ago

    Noida, Uttar Pradesh, India Infinium Associates Full time ₹ 40,00,000 - ₹ 48,00,000 per year

    About the Role:We are seeking a talented Lead Data Engineer to join our team and play a pivotal role in transforming raw data into valuable insights. As a Data Engineer, you will design, develop, and maintain robust data pipelines and infrastructure to support our organization's analytics and decision-making processes.Responsibilities:Data Pipeline...

  • Lead Data Engineer

    24 hours ago

    Noida, Uttar Pradesh, India Conduent Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Overview  We are looking for a Data Engineer who will be part of our Analytics Practice and will be expected to actively work in a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project; its primary responsibility is the...

  • Lead Data Science Engineer

    20 hours ago

    Noida, Uttar Pradesh, India S&P Global Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role: Grade Level (for internal use): AI/ML Lead - Software Engineering We are seeking a highly skilled and motivated AI/ML Engineer Lead to join our team. The ideal candidate will have a strong background in machine learning and data science, with experience working on large-scale machine learning projects. As a Machine Learning...

  • Lead Data Engineer

    22 hours ago

    Noida, Uttar Pradesh, India Dmi Innovations Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Duties and Responsibilities:Demonstrate skills in abstract development frameworks.Demonstrate accountability to assigned work & timelines.Demonstrated leadership skills.Demonstrated technical competency for the role.Demonstrated timely delivery on assigned tasks and effective communication on project status and escalation when needed.Education and...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Veersa Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    SE/ Senior Data Engineer (with SQL, Python, Airflow, Bash)About The RoleWe are seeking a highly skilled and experiencedSenior/Lead Data Engineerto join our growing Data Engineering Team. In this critical role, you will design, architect, and develop cutting-edge multi-tenant SaaS data solutions hosted onAzure Cloud. Your work will focus on delivering robust,...

  • Lead Data Scientist

    1 week ago

    Noida, Uttar Pradesh, India E-Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Lead Data ScientistLocation: NoidaEmployment Type: Full-timeResponsibilities:Lead and manage a team of data scientists, providing guidance, mentorship, and technical expertiseCollaborate with stakeholders to understand business objectives and develop data science strategies aligned with those objectivesDesign, develop, and implement advanced...

  • ISenior Data Strategy Consultant

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data Strategy Consultant Summary: Are you passionate about leveraging data to drive strategic decisions and innovation in a dynamic industry? As a Senior Data Strategy Consultant, you will play a pivotal role in our journey to become a data-driven organization. You will design and implement comprehensive data strategies that align with...