Data Engineer

1 week ago

Navi Mumbai, India UIX Labs Full time

Description : We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands on experience in building and optimizing real?time and batch pipelines, and will be expected to solve real coding problems during the interview.Job Description :- Design, develop, and maintain real time and batch data pipelines in Databricks.- Integrate Apache Kafka with Databricks using Structured Streaming.- Implement robust data ingestion frameworks using Databricks Autoloader.- Build and maintain Medallion Architecture pipelines across Bronze, Silver, and Gold layers.- Implement checkpointing, output modes, and appropriate processing modes in structured streaming jobs.- Design and implement Change Data Capture (CDC) workflows and Slowly Changing Dimensions (SCD) Type 1 and Type 2 logic.- Develop reusable components for merge/upsert operations and window function-based transformations.- Handle large volumes of data efficiently through proper partitioning, caching, and cluster tuning techniques.- Collaborate with cross?functional teams to ensure data availability, reliability, and consistency.Must Have :- Apache Kafka: Integration, topic management, schema registry (Avro/JSON).Databricks & Spark Structured Streaming :Designation Data Engineer- 3 - 6 YearsLocation : Mumbai (onsite)Experience :- Processing Modes: Append, Update, Complete- Output Modes: Memory, Console, File, Kafka, Delta- Checkpointing and fault tolerance- Databricks Autoloader: Schema inference, schema evolution, incremental loads.- Medallion Architecture implementation expertise.Performance Optimization :- Data partitioning strategies- Caching and persistence- Adaptive query execution and cluster configuration tuning- SQL & Spark SQL: Proficiency in writing efficient queries and transformations.- Data Governance: Schema enforcement, data quality checks, and monitoring.Good to Have :- Strong coding skills in Python and PySpark.- Experience working in CI/CD environments for data pipelines.- Exposure to cloud platforms (AWS/Azure/GCP).- Understanding of Delta Lake, time travel, and data versioning.- Familiarity with orchestration tools like Airflow or Azure Data Factory (ref:hirist.tech)

  • Mechanical Design Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Nxtra Data Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Engineer to oversee Data center Design for all new HyperScale and Edge Data Centers. Right from site selection, civil and architectural design from HVAC side including chillers, precision air handling units, fan wall units, VRF, thermal storage tanks, pumps, PACsand low side works.The candidate's job will be to ensure that the Design for every data center...

  • Data Engineer/Sr Data Engineer

    6 days ago

    Ahmedabad, Hyderabad, Navi Mumbai, India IT Company - Data Science & AI Services Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Guarantee that Databricks best practices are appliedthroughout all projectsYour role will involve designing and building robust data pipelinedevelopment and deployment of innovative big data and AI applicationsadvanced data engineering techniques Required Candidate profileExpert-level proficiency in Spark Scala, Python, and PySpark. Knowledge of data...

  • Data Engineer

    4 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Data Engineer

    4 weeks ago

    Mumbai, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahrshtra (IN-MH), India (IN). Job Duties: Key Responsibilities: . Design...

  • Mechanical Shift Engineer

    7 days ago

    Navi Mumbai, Maharashtra, India Bridge Data Centres Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    A graduate in Electrical or Mechanical Engineering / Professional Engineering Diploma. With Good Communication skills5-7 years of experience in running large data Center operation.Should have good understanding of Data Centres Tier certificationsShift allowanceOver time allowanceHealth insuranceLife insuranceAccidental insuranceAnnual bonusProvident fund

  • Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India Pratyarth Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are seeking a skilled and motivated Data Engineer with 8+ years of experience to join our team. The ideal candidate should be experienced in data engineering on Databricks, with a focus on developing, maintaining, and optimizing large-scale data pipelines and solutions. You will collaborate with cross-functional teams to deliver...

  • Data Engineer

    1 week ago

    Navi Mumbai, Maharashtra, India Talent Future Full time ₹ 4,00,000 - ₹ 6,00,000 per year

    Company DescriptionAt Talent Future, we specialize in leveraging talent intelligence to drive business success. Through a data-driven approach, we enable organizations to optimize their talent acquisition strategies and make informed decisions. Our team consists of skilled professionals with extensive experience in recruitment analytics and industry...

  • Data Engineer

    1 week ago

    Navi Mumbai, Maharashtra, India Neuiq Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role & responsibilitiesJob Title: Data EngineerExperience: 3 - 7 yearsLocation: HybridEmployment Type: Full-timeAbout the RoleWe are looking for a Data Engineer who will play a key role in designing, building, and maintaining robust data pipelines that power our AI-based analytics and dashboarding solutions. The candidate should have a strong foundation in...

  • Senior Data Engineer

    2 weeks ago

    Navi Mumbai, Maharashtra, India SoftPixel Solutions Pvt. Ltd. Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Job Title: Senior Data Engineer – Commerce Platform | Data Architecture & IntegrationJob Summary:We are looking for an experienced Senior Data Engineer (12–15 years) to design, develop, and optimize data solutions that power insights and analytics across our commerce ecosystem. You will play a key role in building scalable data platforms, integrating...