Senior Data Engineer

17 hours ago

Hyderabad, Telangana, India Careeco Full time

Job Title : Senior-Level Data Engineer Healthcare Domain

Location: Remote Option

Experience: 5+ Years

Employment Type: Full-Time

About the Role

We are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines. The ideal candidate brings deep technical expertise in building large-scale data platforms, optimizing performance, and ensuring compliance with healthcare data standards (e.g., HIPAA, EDI, HCC). This role requires the ability to lead data initiatives, mentor junior engineers, and work cross-functionally with product, analytics, and compliance teams.

Key Responsibilities

  • Architect, develop, and manage large-scale, secure, and high-performance data pipelines on Databricks using Spark, Delta Lake, and cloud-native tools.
  • Design and implement healthcare-specific data models to support analytics, AI/ML, and operational reporting.
  • Ingest and transform complex data types such as 837/835 claims, EHR/EMR records, provider/member files, lab results, and clinical notes.
  • Lead data governance, quality, and security initiatives ensuring compliance with HIPAA, HITECH, and organizational policies.
  • Collaborate with cross-functional stakeholders to understand data needs and provide robust, scalable solutions.
  • Mentor junior and mid-level engineers, performing code reviews and technical guidance.
  • Identify performance bottlenecks and implement optimizations in Spark jobs and SQL transformations.
  • Own and evolve best practices for CI/CD, version control, and deployment automation.
  • Stay up to date with industry standards (e.g., FHIR, HL7, OMOP) and evaluate new tools/technologies.

Required Qualifications

  • 5+ years of experience in data engineering, with 3+ years in healthcare or life sciences domain.
  • Deep expertise with Databricks,Scala, Apache Spark (preferably PySpark), and Delta Lake.
  • Proficiency in SQL, Python, and data modeling (dimensional/star schema, normalized models).
  • Strong command over 837/835 EDI formats, CPT/ICD-10/DRG/HCC coding, and data regulatory frameworks.
  • Experience with cloud platforms such as Azure, AWS, or GCP and cloud-native data services (e.g., S3, ADLS, Glue, Data Factory).
  • Familiarity with orchestration tools like Airflow, dbt, or Azure Data Factory.
  • Proven ability to work in agile environments, manage stakeholder expectations, and deliver end-to-end data products.
  • Experience implementing monitoring, observability, and alerting for data pipelines.
  • Strong written and verbal communication skills for both technical and non-technical audiences.

Education

  • Bachelors degree in Business Administration, Healthcare Informatics, Information Systems, or a related field.

  • Senior Data Engineer

    17 hours ago

    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Senior Data EngineerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...

  • Senior Data Engineer

    12 hours ago

    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Senior Data EngineerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...

  • Senior Data Engineer

    11 hours ago

    Hyderabad, Telangana, India Statistics & Data Corporation (SDC) Full time

    Senior Data EngineerStatistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services...

  • Senior Data Engineer

    14 hours ago

    Hyderabad, Telangana, India SDC (Statistics & Data Corporation) Full time

    Statistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top-tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC providing a technology enabled service offering to provide clients with both clinical services expertise, as well as...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Valzo Soft Solutions Full time

    Job Description– Senior Data EngineerExperience:5–7 YearsLocation:Hyderabad, Telangana, IndiaEmployment Type:Full-TimeJoining:Immediate HiringPosition OverviewWe are hiring a Senior Data Engineer to lead the development and optimization of scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and PySpark. The role involves managing Data Lake...

  • AI Data Engineer

    15 hours ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India WalkingTree Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Company DescriptionFounded in 2008, WalkingTree Technologies is a pioneering IT services company specializing in digital and data solutions. We collaborate with our clients to shape and execute their data and digital strategies, unlocking their full potential. Our core strengths in Product Engineering, Digital Transformation, and Modernization create a...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 25,00,000 per year

    Role : Senior Data EngineerSonatype India - HybridWho We AreAt Sonatype, we help organizations build better, more secure software by enabling them to understand and control their software supply chains. Our products are trusted by thousands of engineering teams globally, providing critical insights into dependency health, license risk, and software security....

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Info Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...