Senior Data Engineer

6 days ago

Mumbai, India Talent Socio Full time

Description :We are building a next-generation Customer Data Platform (CDP) powered by the Databricks Lakehouse architecture and Lakehouse Engine framework. We're looking for a skilled Data Engineer with 4-9 years of experience to help us build metadata-driven pipelines, enable real-time data processing, and support marketing campaign orchestration capabilities at scale.The core responsibilities for the job include the following :Lakehouse Engine Implementation :- Configure and extend the Lakehouse Engine framework for batch and streaming pipelines.- Implement the medallion architecture (Bronze -> Silver -> Gold) using Delta Lake.- Develop metadata-driven ingestion patterns from various customer data sources.- Build reusable transformers for PII handling, data standardization, and data quality enforcement.Real-Time CDP Enablement :- Build Spark Structured Streaming pipelines for customer behavior and event tracking.- Set up Debezium + Kafka for Change Data Capture (CDC) from CRM systems.- Design and develop identity resolution logic across both streaming and batch datasets.DataOps and Governance :- Use Unity Catalog for managing RBAC, data lineage, and auditability.- Integrate Great Expectations or similar tools for continuous data quality monitoring.- Set up CI/CD pipelines for deploying Databricks notebooks, jobs, and DLT pipelines.Requirements :- 4-9 years of hands-on experience in data engineering.- Expertise in Databricks Lakehouse platform, Delta Lake, and Unity Catalog.- Advanced PySpark skills, including Structured Streaming.- Experience implementing Kafka + Debezium CDC pipelines.- Strong in SQL transformations, data modeling, and analytical querying.- Familiarity with metadata-driven architecture and parameterized pipelines.- Understanding of data governance : PII masking, access controls, and lineage tracking.- Proficiency in working with AWS, MongoDB, and PostgreSQL.Nice to Have :- Experience working on Customer 360 or Martech CDP platforms.- Familiarity with Martech tools like Segment, Braze, or other CDPs.- Exposure to ML pipelines for segmentation, scoring, or personalization.- Knowledge of CI/CD for data workflows using GitHub Actions, Terraform, or Databricks CLI. (ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...

  • Senior data engineer

    5 days ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...

  • Senior data engineer

    4 days ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:Wwc GUHf7rti Fa ARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks...

  • Senior Data Engineer

    4 days ago

    mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)📌 Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a...

  • Senior Data Engineer

    3 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based...

  • Senior data engineer

    3 weeks ago

    Mumbai, India EClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    5 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    6 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks)Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and cloud-based data...

  • Senior Data Engineer

    2 days ago

    Mumbai, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step: If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless: Role Overview: We are seeking a highly experienced Senior Data Engineering Lead with a strong focus on Databricks and...

  • Senior Data Engineer

    7 days ago

    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...