Data Engineer

2 weeks ago

Mumbai, India Talent Socio Full time

We are building a next-generation Customer Data Platform (CDP) powered by the Databricks Lakehouse architecture and Lakehouse Engine framework. We're looking for a skilled Data Engineer with 4-9 years of experience to help us build metadata-driven pipelines, enable real-time data processing, and support marketing campaign orchestration capabilities at scale.


Responsibilities :


- Configure and extend the Lakehouse Engine framework for batch and streaming pipelines.

- Implement the medallion architecture (Bronze -> Silver -> Gold) using Delta Lake.

- Develop metadata-driven ingestion patterns from various customer data sources.

- Build reusable transformers for PII handling, data standardization, and data quality enforcement.

- Build Spark Structured Streaming pipelines for customer behavior and event tracking.

- Set up Debezium + Kafka for Change Data Capture (CDC) from CRM systems.

- Design and develop identity resolution logic across both streaming and batch datasets.

- Use Unity Catalog for managing RBAC, data lineage, and auditability.

- Integrate Great Expectations or similar tools for continuous data quality monitoring.

- Set up CI/CD pipelines for deploying Databricks notebooks, jobs, and DLT pipelines.


Requirements :


- 4-9 years of hands-on experience in data engineering.

- Expertise in Databricks Lakehouse platform, Delta Lake, and Unity Catalog.

- Advanced PySpark skills, including Structured Streaming.

- Experience implementing Kafka + Debezium CDC pipelines.

- Strong in SQL transformations, data modeling, and analytical querying.

- Familiarity with metadata-driven architecture and parameterized pipelines.

- Understanding of data governance: PII masking, access control, and lineage tracking.

- Proficiency in working with AWS, MongoDB, and PostgreSQL.

- Experience working on Customer 360 or Martech CDP platforms.

- Familiarity with Martech tools like Segment, Braze, or other CDPs.

- Exposure to ML pipelines for segmentation, scoring, or personalization.

- Knowledge of CI/CD for data workflows using GitHub Actions, Terraform, or Databricks CLI.


(ref:hirist.tech)

  • Data Engineer

    3 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: ....

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...

  • Data Engineer

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer Req ID: 340021 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties: Key...

  • Lead Mechanical Engineer

    5 days ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Mid Data Science

    1 week ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India...

  • Mid Data Science

    2 weeks ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India...

  • Mid Data Science

    1 week ago

    Mumbai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Mumbai, Mahārāshtra (IN-MH),...

  • Lead Mechanical Engineer

    2 weeks ago

    Navi Mumbai, India BDx Data Centers Full time

    Big Data Exchange (BDX), A leading Pan Asian hybrid, hyperscale and edge solutions provider with assets located in Hong Kong, Singapore, Guangzhou, Nanjing, Indonesia and expanding footprints in SEA regions. Our hybrid ecosystem provides colocation, Enterprise Services, private cloud services, disaster recovery services, and interconnect solutions across...

  • Data Engineer

    7 days ago

    Mumbai Metropolitan Region, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:342707NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN).Job Duties: Key Responsibilities:Design and...