Senior Data Engineer

7 days ago

Navi Mumbai, Maharashtra, India 60149c98-b064-4b14-99c8-5e78db81750a Full time ₹ 15,00,000 - ₹ 30,00,000 per year

Data Engineer

Designation: Data Engineer Experience: 6-8 Years Location: Mumbai (onsite)

Job Summary

We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview.

Job Description

Key Responsibilities

Design, develop, and maintain real-time and batch data pipelines in Databricks

Integrate Apache Kafka with Databricks using Structured Streaming

Implement robust data ingestion frameworks using Databricks Autoloader

Build and maintain Medallion Architecture pipelines across Bronze, Silver, and Gold layers

Implement checkpointing, output modes, and appropriate processing modes in structured streaming jobs

Design and implement Change Data Capture (CDC) workflows and Slowly Changing Dimensions (SCD) Type 1 and Type 2 logic

Develop reusable components for merge/upsert operations and window function-based transformations Handle large volumes of data efficiently through proper partitioning, caching, and cluster tuning techniques Collaborate with cross-functional teams to ensure data availability, reliability, and consistency

Must Have Skills Apache Kafka

Integration, topic management, schema registry (Avro/JSON)

Databricks & Spark Structured Streaming Processing Modes: Append, Update, Complete

Output Modes: Memory, Console, File, Kafka, Delta Checkpointing and fault tolerance

Databricks Autoloader

Schema inference, schema evolution, incremental loads

Medallion Architecture

Full implementation expertise across Bronze, Silver, and Gold layers

Performance Optimization

Data partitioning strategies

Caching and persistence

Adaptive query execution and cluster configuration tuning

SQL & Spark SQL

Proficiency in writing efficient queries and transformations

Data Governance

Schema enforcement, data quality checks, and monitoring

Good to Have

Strong coding skills in Python and PySpark

Experience working in CI/CD environments for data pipelines Exposure to cloud platforms (AWS/Azure/GCP)

Understanding of Delta Lake, time travel, and data versioning Familiarity with orchestration tools like Airflow or Azure Data Factory

Job Types: Full-time, Permanent

Pay: ₹1,500, ₹3,000,000.00 per year

Benefits:

  • Health insurance
  • Leave encashment
  • Life insurance
  • Paid sick time
  • Provident Fund

Ability to commute/relocate:

  • Navi Mumbai, Maharashtra: Reliably commute or planning to relocate before starting work (Required)

Location:

  • Navi Mumbai, Maharashtra (Preferred)

Work Location: In person

  • Senior Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India SoftPixel Solutions Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Job Title: Senior Data Engineer – Commerce Platform | Data Architecture & IntegrationJob Summary:We are looking for an experienced Senior Data Engineer (12–15 years) to design, develop, and optimize data solutions that power insights and analytics across our commerce ecosystem. You will play a key role in building scalable data platforms, integrating...

  • Senior Data Analyst

    7 days ago

    Navi Mumbai, Maharashtra, India Peoplefy Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Title: Senior Data AnalystLocation: Navi Mumbai (Onsite)Walk in Drive: 22 November, Saturday at Sector 40, Navi MumbaiMust Have Skills:Programming & Technology: Strong hands-on SQL knowledge is preferred, and experience with Python/R, statistical methods, and machine learning algorithms to develop predictive models.Databases: MySQL, SQL Server, Oracle SQL,...

  • Data Engineer

    2 hours ago

    Navi Mumbai, Maharashtra, India Ventura Securities Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    About the Company :Ventura is an omnichannel trading and investment platform with a network of branches, sub-brokers and Digital Channels. Founded in 1994, the company is entering the next phase of growth by pivoting to a digital-first approach and strengthening its direct-to-consumer franchise. The company has carved out a separate fintech vertical tasked...

  • Mechanical Design Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...

  • Senior Data Engineer

    2 days ago

    Mumbai, Maharashtra, India All European Careers Full time  1,20,000 -  1,80,000 per year

    For an international organization in Geneva, Switzerland, we are urgently looking for a Full Remote Senior Data Engineer. The Senior Data Engineer is responsible for the implementation of the set of automated ETL pipelines, implementation of the analytics of the platform operations and importing new data sources and its maintenance. The Analytics Data...

  • Associate Professor in Data Science

    7 days ago

    Mumbai, Maharashtra, India Brookdale Senior Living Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    DepartmentBusinessJob posted onNov 18, 2025Employment typePermanentHiring for Associate Professor in Data Science / Statistics, University of Bristol, MumbaiAbout the University of Bristol:The University of Bristol's Mumbai campus is an innovative extension of its prestigious UK counterpart, established to promote academic excellence, global collaboration,...

  • Senior Data Scientist

    2 weeks ago

    Navi Mumbai, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title:Senior Data Scientist Overview:Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our...

  • Senior Associate Automation Engineer

    4 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Senior...

  • Senior Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience: yearsSalary: Confidential (based on experience)Shift: (GMT+05:30) Asia/Kolkata (IST)Opportunity Type: RemotePlacement Type: Full time Permanent Position(*Note: This is a requirement for one of Uplers' client - Forbes Advisor)What do you need for this opportunity?Must have skills required: Airflow, dbt, Google CloudForbes Advisor is Looking...

  • Senior Stress Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Rejlers Abu Dhabi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Rejlers International Engineering Solutions is a trusted provider of high-quality engineering and project services. We have been present in Abu Dhabi, UAE, for over 15 years.Operating from our regional headquarters in Abu Dhabi City and with an own office in Navi Mumbai, India, we support a wide range of operations across the region. Specializing in the Oil...