Senior Data Engineer
2 weeks ago
Description :We are building a next-generation Customer Data Platform (CDP) powered by the Databricks Lakehouse architecture and Lakehouse Engine framework. We're looking for a skilled Data Engineer with 4-9 years of experience to help us build metadata-driven pipelines, enable real-time data processing, and support marketing campaign orchestration capabilities at scale.The core responsibilities for the job include the following :Lakehouse Engine Implementation :- Configure and extend the Lakehouse Engine framework for batch and streaming pipelines.- Implement the medallion architecture (Bronze -> Silver -> Gold) using Delta Lake.- Develop metadata-driven ingestion patterns from various customer data sources.- Build reusable transformers for PII handling, data standardization, and data quality enforcement.Real-Time CDP Enablement :- Build Spark Structured Streaming pipelines for customer behavior and event tracking.- Set up Debezium + Kafka for Change Data Capture (CDC) from CRM systems.- Design and develop identity resolution logic across both streaming and batch datasets.DataOps and Governance :- Use Unity Catalog for managing RBAC, data lineage, and auditability.- Integrate Great Expectations or similar tools for continuous data quality monitoring.- Set up CI/CD pipelines for deploying Databricks notebooks, jobs, and DLT pipelines.Requirements :- 4-9 years of hands-on experience in data engineering.- Expertise in Databricks Lakehouse platform, Delta Lake, and Unity Catalog.- Advanced PySpark skills, including Structured Streaming.- Experience implementing Kafka + Debezium CDC pipelines.- Strong in SQL transformations, data modeling, and analytical querying.- Familiarity with metadata-driven architecture and parameterized pipelines.- Understanding of data governance : PII masking, access controls, and lineage tracking.- Proficiency in working with AWS, MongoDB, and PostgreSQL.Nice to Have :- Experience working on Customer 360 or Martech CDP platforms.- Familiarity with Martech tools like Segment, Braze, or other CDPs.- Exposure to ML pipelines for segmentation, scoring, or personalization.- Knowledge of CI/CD for data workflows using GitHub Actions, Terraform, or Databricks CLI. (ref:hirist.tech)
-
Senior Manager
1 week ago
Mumbai, India NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...
-
Senior Data Engineer
2 weeks ago
Mumbai, India Fluent Health Full timeAbout Us: Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and...
-
Senior Data Engineer
2 weeks ago
Mumbai, India Fluent Health Full timeAbout Us: Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and...
-
Senior Data Engineer
3 weeks ago
Mumbai, India Fluent Health Full timeAbout Us:Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and experienced...
-
Senior Data Engineer
4 weeks ago
Mumbai, India Fluent Health Full timeAbout Us:Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and experienced...
-
Senior data engineer
4 weeks ago
Mumbai, India Fluent Health Full timeAbout Us:Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and experienced...
-
Senior Data Engineer
3 weeks ago
Mumbai, India Fluent Health Full timeAbout Us:Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and experienced...
-
Senior Data Engineer
4 weeks ago
Mumbai, India Fluent Health Full timeAbout Us:Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and experienced...
-
Senior Data Engineer
3 weeks ago
Mumbai, India Fluent Health Full timeAbout Us: Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and...
-
Senior Data Engineer
4 weeks ago
Mumbai, India Fluent Health Full timeAbout Us: Fluent Health is a dynamic healthcare startup revolutionizing how you manage your healthcare and that of your family. The company will provide customers with high-quality, personalized options, credible information through trustworthy content, and absolute privacy. To assist us in our growth journey, we are seeking a highly motivated and...
