Lead Data Engineer

one of the leading healthcare technology Product organizations with $1.4 Billion revenue with year-on-year growth of 22% and client retention rate of 120%. we offer wide range of innovative solutions to the healthcare payers, providers, and consumers. Our services include network analytics, payment integrity and optimization, provider credentialing, and provider engagement.

Requirements

As a Lead Data Engineer, you will architect, design, and oversee the development of scalable batch and real-time data pipelines across cloud and on-prem environments. You’ll drive data integration strategies, dimensional modeling, and data governance initiatives while mentoring junior engineers and collaborating with cross-functional teams. Your role will be pivotal in shaping the data infrastructure and ensuring high-quality, secure, and performant data solutions that support enterprise analytics and reporting.

🛠 Responsibilities

- Architect and implement robust ETL/ELT pipelines for Data Warehouses and Data Lakes using modern frameworks and tools
- Lead the design of dimensional data models and ensure alignment with enterprise data architecture standards
- Oversee the development and maintenance of SQL-based solutions including stored procedures, views, triggers, and functions
- Guide the team in optimizing SQL queries and database performance tuning
- Define and enforce best practices for data quality, lineage, and auditability across all pipelines
- Collaborate with data analysts, BI developers, and business stakeholders to translate requirements into scalable solutions
- Own the CI/CD strategy for data engineering workflows using Azure DevOps and Git
- Ensure compliance with privacy and security standards (e.g., HIPAA, SOC 2, ISO 27001)
- Maintain and evolve documentation including source-to-target mappings, design specs, and test cases
- Lead root cause analysis and resolution of data issues across environments
- Champion continuous improvement initiatives and evaluate emerging technologies for adoption

📌 Requirements

- 12+ years of experience in data engineering, including extensive experience in ETL/ELT development, data modeling, and performance tuning
- 5+ years of experience leading data engineering teams or projects
- Expert-level proficiency in SQL Server and T-SQL (procedures, triggers, views, indexing strategies)
- Deep experience with SSIS and cloud-based ETL tools (DBT preferred)
- Strong understanding of Data Lake and Data Warehouse architectures (Azure Synapse, Snowflake, Redshift, etc.)
- Proven experience designing and implementing dimensional models for enterprise-scale analytics
- Hands-on experience with Azure Data Factory, Azure DevOps, Git, and CI/CD pipelines
- Working knowledge of AWS and Azure cloud ecosystems
- Experience with reporting tools such as Power BI, SSRS, and Tableau
- Familiarity with Agile methodologies, Jira, and Confluence
- Strong business acumen with experience in healthcare, fintech, or payment processing domains

🌟 Preferred Skills

- Experience with data governance frameworks and metadata management
- Exposure to real-time data streaming technologies (Kafka, Spark Streaming, etc.)
- Experience mentoring junior engineers and conducting code reviews
- Strong stakeholder management and communication skills
- Experience with data cataloging tools and lineage tracking (e.g., Azure Purview, Alation)

🧭 Leadership & Accountability

- Operates with high autonomy and accountability for deliverables and team outcomes
- Sets technical direction and drives execution across multiple projects
- Coaches and mentors team members to elevate engineering standards
- Proactively identifies risks and mitigation strategies
- Collaborates across engineering, product, and business teams to align data initiatives with strategic goals

🧩 Problem Solving & Innovation

- Demonstrates advanced analytical and troubleshooting skills
- Leads complex data investigations and drives resolution
- Innovates and proposes scalable solutions to evolving data challenges
- Prioritizes effectively and manages competing demands with clarity and focus

Benefits

Insurance Coverage

• Paid Leaves – including maternity and paternity. • Financial assistance for medical crisis

• Customized Mindfulness and Wellness programs • Hybrid Work Model

• Certification trainings for technical and soft skills • Access to unlimited LinkedIn Learning platform • Community networking and idea creation platforms • Mentorship programs

• Self-driven career progression tool.