Senior Data Engineer- Databricks

2 days ago

Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per year

We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industry

experience. The ideal candidate will have a proven track record of working on live projects,

preferably within the manufacturing or energy sectors. He/she will play a key role in developing

and maintaining scalable data solutions using Databricks and related technologies.

Key Responsibilities:

  • Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with
  • various data sources and systems.
  • Collaborate with cross-functional teams to understand data, and deliver effective BI
  • solutions.
  • Implement data ingestion, transformation, and processing workflows using Spark
  • (PySpark/Scala), SQL, and Databricks notebooks.
  • Develop and maintain data models, ETL/ELT processes ensuring high performance,
  • reliability, scalability and data quality.
  • Build and maintain APIs and data services to support analytics, reporting, and application
  • integration.
  • Ensure data quality, integrity, and security across all stages of the data lifecycle.
  • Monitor, troubleshoot, and optimize pipeline performance in a cloud-based environment.
  • Write clean, modular, and well-documented Python/Scala/SQL/PySpark code.
  • Integrate data from various sources, including APIs, relational and non-relational databases,
  • IoT devices, and external data providers.
  • Ensure adherence to data governance, security, and compliance policies.

Required Skills and Experience:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 5-6 years of hands-on experience in data engineering, with a strong focus on Databricks and
  • Apache Spark.
  • Strong programming skills in Python/PySpark and/or Scala, with a deep understanding of
  • Apache Spark.
  • Experience with Azure Databricks.
  • Strong SQL skills for data manipulation, analysis, and performance tuning.
  • Strong understanding of data structures and algorithms, with the ability to apply them to
  • optimize code and implement efficient solutions.
  • Strong understanding of data architecture, data modeling, ETL/ELT processes, and data
  • warehousing concepts.
  • Experience building and maintaining ETL/ELT pipelines in production environments.
  • Familiarity with Delta Lake, Unity Catalog, or similar technologies.
  • Experience working with structured and unstructured data, including JSON, Parquet, Avro,
  • and time-series data.
  • Familiarity with CI/CD pipelines and tools like Azure DevOps, version control (Git), and
  • DevOps practices for data engineering.
  • Excellent problem-solving skills, attention to detail, and ability to work independently or as
  • part of a team.
  • Strong communication skills to interact with technical and non-technical stakeholders.

Preferred Qualifications:

Experience with Delta Lake and Databricks Workflows.

Exposure to real-time data processing and streaming technologies (Kafka, Spark Streaming).

Exposure to the data visualization tool Databricks Genie for data analysis and reporting.

Knowledge of data governance, security, and compliance best practices.

  • Databricks Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Crisil Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Position Overview:The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.Key...

  • Senior Data Engineer

    3 days ago

    Mumbai, Maharashtra, India Oracle Financial Services Software Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Consultant - Databricks Senior Data Engineer – Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...

  • Senior Azure Databricks Engineer

    1 week ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Data Engineer- databricks

    4 days ago

    Mumbai, Maharashtra, India Qualintia Solutions Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Role- Data Engineer- DatabricksExp- 8+ years,Job Type- ContractualLocation- MumbaiWork Mode- WFO• Learning & Certification Opportunities: Enhance your professional growth.• Comprehensive Medical Coverage and Life Insurance: For your well-being.• Flexible Work Environment: Enjoy a 5-day work week.• Collaborative Culture: Be part of a fun, innovative...

  • Delivery Solutions Architect

    19 hours ago

    Mumbai, Maharashtra, India Databricks Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Delivery Solutions Architect CSQ426R270 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering...

  • Senior Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India eClerx Full time

    Job Title: Senior Data Engineering Lead (Databricks) Next Step:If this role excites you and matches your expertise, kindly fill out the Google Form with the required details so we can reach out to you and make the process seamless:https://forms.gle/Z6qWwcGUHf7rtiFaARole Overview:We are seeking a highly experienced Senior Data Engineering Lead with a strong...

  • Senior Azure Databricks Engineer

    1 day ago

    Mumbai, Maharashtra, India, Maharashtra MLAI Digital Private Ltd. Full time

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Databricks

    2 weeks ago

    Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Data Architect-Databricks

    1 week ago

    Navi Mumbai, Maharashtra, India Celebal Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We Are Hiring Databricks Data Architect | Navi Mumbai (Onsite)Are you passionate about designing scalable, enterprise-grade data platforms?Join Celebal Technologies and work on cutting-edge Azure Databricks solutions in the manufacturing and energy sectorsRole: Databricks Data ArchitectExperience: 10+ YearsLocation: Navi Mumbai (Onsite)Notice Period:...

  • Data Engineer

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...