Data Engineer Lead

5 days ago

Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Profile - Data Engineer Lead

Exp- 7+ Years

Location - Noida

Work Mode - Hybrid

Skills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousing

for applying you can share your CV on

Key Responsibilities

Data Engineering & Pipeline Development:

·      Develop and maintain robust, scalable ETL pipelines to ingest, clean, and transform public (e.g., CMS, Medicaid), private (e.g., commercial claims, EHRs), and purchased (e.g., Clarivate, Doceree) datasets.

  • Optimize data workflows and storage solutions to enhance data accessibility and usability for analytics and business intelligence teams.
  • Implement data quality frameworks, ensuring the integrity and accuracy of healthcare datasets used for decision-making.
  • Collaborate with data architects to design and enhance data models, ensuring efficient query performance and integration across multiple sources.

Collaboration with External Vendors & Partners:

  • Work closely with external data vendors, research organizations, and commercial agencies to define projects, ensure data consistency, and improve ingestion processes.
  • Provide technical oversight on vendor-sourced data projects, ensuring compliance with Avalere's data quality and governance standards.
  • Support the evaluation and acquisition of new datasets, integrating them into Avalere's data ecosystem for analytics and modeling.

Internal Team Leadership & Support:

  • Partner with data scientists, analysts, and market access teams to develop data solutions that drive business insights.
  • Provide technical mentorship to junior data engineers, ensuring best practices in data pipeline development, automation, and cloud-based infrastructure.
  • Work cross-functionally with data architects and analytics teams to align data engineering efforts with business and research objectives.

Required Skills and Experience

Education:

  • Bachelor's degree in computer science, information systems, data engineering, or a related field. Master's degree preferred.

Technical Expertise:

  • Extensive experience in building and managing ETL pipelines for large-scale healthcare data processing.
  • Strong knowledge of public healthcare datasets, including Medicare/Medicaid claims, state health registries, and government-funded research data.
  • Experience with private-sector datasets, such as commercial claims, EHRs, and provider-generated data.
  • Proficiency in SQL, Python, and Spark for large-scale data processing and transformation.
  • Hands-on experience with cloud platforms (AWS, Azure, GCP) and big data technologies (Databricks, Snowflake, Hadoop).
  • Deep understanding of data modeling, data warehousing, and governance best practices.
  • Experience implementing data security and compliance frameworks, including HIPAA, HITRUST, and other healthcare regulations.

Professional Experience:

  • 8+ years of experience in data engineering, pipeline development, or a related field, preferably within healthcare, consulting, or analytics.
  • Demonstrated ability to integrate, process, and optimize multi-source datasets for analytics and research applications.
  • Experience managing data acquisition projects and working with external vendors to refine data ingestion approaches.

Proven track record in developing scalable cloud-based data solutions for enterprise-wide use.

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead Data Engineer - Azure CloudExperience: Years Exp.Salary: CompetitivePreferred Notice Period: 30 DaysShift: 10:00 AM to 7:00 PM ISTOpportunity Type: Noida (Remote for 6 months, Later Hybrid)Placement Type: Permanent(*Note: This is a requirement for one of Uplers' Clients)Must have skills required :Engineering management, Data Engineering, Azure Data...

  • Lead Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Conduent Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job OverviewWe are looking for a Data Engineer who will be part of our Analytics Practice and will be expected to actively work in a multi-disciplinary fast paced environment. This role requires a broad range of skills and the ability to step into different roles depending on the size and scope of the project; its primary responsibility is the acquisition,...

  • Data Lead

    7 days ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We're looking for a hands-on Data Lead to architect and deliver end-to-end data features that power our booking and content management systems. You'll lead a team, own the data pipeline lifecycle, and play a critical role in shaping and scaling our data infrastructure — spanning batch, real-time, and NoSQL environments.ShyftLabs is a...

  • Lead Data Engineer- Python

    5 days ago

    Noida, Uttar Pradesh, India Infinium Associates Full time ₹ 40,00,000 - ₹ 48,00,000 per year

    About the Role:We are seeking a talented Lead Data Engineer to join our team and play a pivotal role in transforming raw data into valuable insights. As a Data Engineer, you will design, develop, and maintain robust data pipelines and infrastructure to support our organization's analytics and decision-making processes.Responsibilities:Data Pipeline...

  • Data Engineering Lead

    4 weeks ago

    Noida, Uttar Pradesh, India UnitedHealth Group Full time

    Optum is a global organization that delivers care aided by technology to help millions of people live healthier lives The work you do with our team will directly improve health outcomes by connecting people with the care pharmacy benefits data and resources they need to feel their best Here you will find a culture guided by diversity and inclusion ...

  • Systems Engineering Specialist

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Systems Engineering Specialist to join our team At NTT DATA we know that with the right people on board anything is possible The...

  • Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Veersa Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    SE/ Senior Data Engineer (with SQL, Python, Airflow, Bash)About The RoleWe are seeking a highly skilled and experiencedSenior/Lead Data Engineerto join our growing Data Engineering Team. In this critical role, you will design, architect, and develop cutting-edge multi-tenant SaaS data solutions hosted onAzure Cloud. Your work will focus on delivering robust,...

  • Lead Data Scientist

    7 days ago

    Noida, Uttar Pradesh, India E-Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Lead Data ScientistLocation: NoidaEmployment Type: Full-timeResponsibilities:Lead and manage a team of data scientists, providing guidance, mentorship, and technical expertiseCollaborate with stakeholders to understand business objectives and develop data science strategies aligned with those objectivesDesign, develop, and implement advanced...

  • ISenior Data Strategy Consultant

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data Strategy Consultant Summary: Are you passionate about leveraging data to drive strategic decisions and innovation in a dynamic industry? As a Senior Data Strategy Consultant, you will play a pivotal role in our journey to become a data-driven organization. You will design and implement comprehensive data strategies that align with...

  • Data Engineer

    20 hours ago

    Noida, Uttar Pradesh, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    On Team Xbox, we aspire to empower the world's 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with...