Senior Data Engineer
31 minutes ago
Job Title : Senior-Level Data Engineer Healthcare Domain
Location: Remote Option
Experience: 5+ Years
Employment Type: Full-Time
About the Role
We are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines. The ideal candidate brings deep technical expertise in building large-scale data platforms, optimizing performance, and ensuring compliance with healthcare data standards (e.g., HIPAA, EDI, HCC). This role requires the ability to lead data initiatives, mentor junior engineers, and work cross-functionally with product, analytics, and compliance teams.
Key Responsibilities
- Architect, develop, and manage large-scale, secure, and high-performance data pipelines on Databricks using Spark, Delta Lake, and cloud-native tools.
- Design and implement healthcare-specific data models to support analytics, AI/ML, and operational reporting.
- Ingest and transform complex data types such as 837/835 claims, EHR/EMR records, provider/member files, lab results, and clinical notes.
- Lead data governance, quality, and security initiatives ensuring compliance with HIPAA, HITECH, and organizational policies.
- Collaborate with cross-functional stakeholders to understand data needs and provide robust, scalable solutions.
- Mentor junior and mid-level engineers, performing code reviews and technical guidance.
- Identify performance bottlenecks and implement optimizations in Spark jobs and SQL transformations.
- Own and evolve best practices for CI/CD, version control, and deployment automation.
- Stay up to date with industry standards (e.g., FHIR, HL7, OMOP) and evaluate new tools/technologies.
Required Qualifications
- 5+ years of experience in data engineering, with 3+ years in healthcare or life sciences domain.
- Deep expertise with Databricks,Scala, Apache Spark (preferably PySpark), and Delta Lake.
- Proficiency in SQL, Python, and data modeling (dimensional/star schema, normalized models).
- Strong command over 837/835 EDI formats, CPT/ICD-10/DRG/HCC coding, and data regulatory frameworks.
- Experience with cloud platforms such as Azure, AWS, or GCP and cloud-native data services (e.g., S3, ADLS, Glue, Data Factory).
- Familiarity with orchestration tools like Airflow, dbt, or Azure Data Factory.
- Proven ability to work in agile environments, manage stakeholder expectations, and deliver end-to-end data products.
- Experience implementing monitoring, observability, and alerting for data pipelines.
- Strong written and verbal communication skills for both technical and non-technical audiences.
Education
- Bachelors degree in Business Administration, Healthcare Informatics, Information Systems, or a related field.
-
Senior Data Engineer
6 days ago
Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...
-
Azure Data Engineer
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India ShimentoX Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title: Senior Data EngineerLocation: Hyderabad and BangaloreJob SummaryWe are seeking a highly skilled and experienced Senior Data Engineer to join our growing data engineering team. This role will be instrumental in designing, building, and maintaining scalable data pipelines and architectures to support advanced analytics, data science, and business...
-
Senior Data Engineer
1 week ago
Hyderabad, Telangana, India WalkingTree Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearCompany DescriptionFounded in 2008, WalkingTree Technologies is a pioneering IT services company specializing in digital and data solutions. We collaborate with our clients to shape and execute their data and digital strategies, unlocking their full potential. Our core strengths in Product Engineering, Digital Transformation, and Modernization create a...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Unique IT Solutions, Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per yearCompany DescriptionUnique IT Solutions is a professional information technology services company with deep SAP roots, providing digital transformation solutions and consulting across a wide range of industries. We are known for providing affordable SAP installations and updates utilizing a blended team of onshore and offshore resources. Our Business...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Straive Full timeJob SummaryWe're looking for aSenior Data Engineerwith 5-8 years of experience to build and maintain scalable, production-grade data pipelines. The ideal candidate is a strong software engineer with hands-on experience in Spark (3.x), Scala, SQL, and Python. You'll be responsible for designing and implementing ETL/ELT solutions, collaborating with teams to...
-
Senior Data Engineers
2 weeks ago
Hyderabad, Telangana, India SID Information Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per yearhiring #Hiring #hyderabad #hyderabadjob #HyderabadJobs #immediatejoiner #opportunity #CareerOpportunity #Senior #TechJobs #dataengineer #DataEngineering #DataArchitect #DataEngineeringJobs #HealthcareDataCloudComputing #BigData #DataAnalytics #PlatformEngineering #Terraform #Kubernetes #SQL #Python #Scala #apachespark #pyspark #ETLpipeline #PySpark...
-
Senior Associate Security Platform Engineer
1 week ago
Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearContinue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...
-
Senior Data Engineer
5 days ago
Hyderabad, Telangana, India Microsoft Full time ₹ 15,00,000 - ₹ 25,00,000 per yearAre you passionate about shaping the future applications of AI and empowering millions of users to unlock their full potential? The OneNote team is at the forefront of an exciting transformation with Copilot Notebooks: intelligent, dynamic notebooks infused with powerful AI that act as a true "second brain." Imagine effortlessly capturing ideas, intuitively...
-
Senior Data Engineer
2 weeks ago
Hyderabad, Telangana, India Orbcomm Full time ₹ 12,00,000 - ₹ 24,00,000 per yearJoin Us as a Senior Data Engineer Are you ready to make a significant impact in an innovative environment? At ORBCOMM, we're on the hunt for a passionate Senior Data Engineer who thrives in a fast-paced, agile setting. We want you to transform your ideas into action and drive our mission forward Why You'll Love Working Here: As a key member of our...