Databricks Data Engineer

5 days ago

Mumbai, Maharashtra, India Crisil Full time ₹ 15,00,000 - ₹ 28,00,000 per year

Position Overview:

The Databricks Data Engineer role is ideal for a skilled and motivated Databricks Data Engineer to design, build, and optimize data pipelines and analytics solutions on the Databricks Lakehouse Platform. This role is ideal for candidates who have experience with big data technologies and a passion for building robust data systems.

Key Responsibilities:

  • Develop and maintain scalable data pipelines using Databricks and Apache Spark (primarily with PySpark).
  • Build and manage Delta Lake tables and optimize them for analytics and machine learning workloads.
  • Integrate data from diverse sources including APIs, cloud storage, databases, and streaming platforms like Kafka.
  • Transform raw data into clean, structured formats using best practices in ETL/ELT.
  • Implement data quality checks and ensure consistency, completeness, and accuracy of data sets.
  • Collaborate with data scientists, analysts, and business stakeholders to meet data requirements for reporting and analytics.
  • Automate workflows using Databricks Workflows, job clusters, and scheduling tools.
  • Monitor and optimize Spark jobs for performance and cost efficiency.
  • Document and maintain data models, pipeline designs, and technical workflows.

Qualifications:

  • Education: Bachelor's degree in Computer Science, Engineering, or a related field.
  • Experience:
  • 3+ years of experience in data engineering or software development.
  • 1+ years of hands-on experience working with Databricks and Apache Spark in production environments
  • Skills:
  • Proficient in PySpark and SQL.
  • Solid understanding of data warehousing, ETL/ELT design, and big data best practices.
  • Experience with cloud platforms such as Azure, AWS, or GCP.
  • Experience with Delta Lake, Databricks Workflows, and MLflow.
  • Exposure to data governance tools like Unity Catalog or Purview.
  • Experience with real-time data processing (e.g., using Kafka, Structured Streaming).
  • Familiarity with version control systems (e.g., Git) and CI/CD practices.
  • Familiarity with data visualization tools (e.g., Power BI, Tableau) and BI integration
  • Certifications :
  • Databricks Certified Data Engineer Associate or Professional (a plus).

  • Data Engineer- databricks

    5 days ago

    Mumbai, Maharashtra, India Qualintia Solutions Full time ₹ 8,00,000 - ₹ 25,00,000 per year

    Role- Data Engineer- DatabricksExp- 8+ years,Job Type- ContractualLocation- MumbaiWork Mode- WFO• Learning & Certification Opportunities: Enhance your professional growth.• Comprehensive Medical Coverage and Life Insurance: For your well-being.• Flexible Work Environment: Enjoy a 5-day work week.• Collaborative Culture: Be part of a fun, innovative...

  • Senior Data Engineer- Databricks

    3 days ago

    Mumbai, Maharashtra, India Koantek Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Databricks Full Stack Data Engineer with 5–6 years of industryexperience. The ideal candidate will have a proven track record of working on live projects,preferably within the manufacturing or energy sectors. He/she will play a key role in developingand maintaining scalable data solutions using Databricks and related...

  • Delivery Solutions Architect

    1 day ago

    Mumbai, Maharashtra, India Databricks Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Delivery Solutions Architect CSQ426R270 At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Databricks Data Intelligence Platform. As a Delivery Solutions Architect (DSA), you will play an important role during this journey. You will collaborate with our sales and field engineering...

  • Databricks

    2 weeks ago

    Mumbai, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration, and high performance. As the undisputed leader in professional services, Our Client is where you will find unrivaled opportunities to succeed and realize your full potential.We are seeking highly skilled Databricks Data Engineers to join...

  • Data Architect-Databricks

    1 week ago

    Navi Mumbai, Maharashtra, India Celebal Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We Are Hiring Databricks Data Architect | Navi Mumbai (Onsite)Are you passionate about designing scalable, enterprise-grade data platforms?Join Celebal Technologies and work on cutting-edge Azure Databricks solutions in the manufacturing and energy sectorsRole: Databricks Data ArchitectExperience: 10+ YearsLocation: Navi Mumbai (Onsite)Notice Period:...

  • Data Engineer

    5 days ago

    Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Aws Databricks

    3 days ago

    Mumbai, Maharashtra, India People Prime Worldwide Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As a Data Engineer with 5+ years of hands-on experience in data engineering/ETL using Databricks on AWS/Azure cloud infrastructure and functions, your key responsibilities will include: - Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. - Implementing...

  • Senior Azure Databricks Engineer

    1 week ago

    Mumbai, Maharashtra, India MLAI Digital Private Ltd. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Company DescriptionMLAI_Digital is a GenAI_Agentic Specialised Organisation(8 Years old) providing Various Cognitive Products well suited for major BFSI Institutions.Offices in US(ohio) ,Singapore (PTE), Malaysia , India and Australia(MEL) Domain expertise:- FINANCIAL INSTITUTIONS(Banks & Insurance) and Fraud Analytics for Financial TransactionsRole...

  • Databricks Developer

    7 days ago

    Mumbai, Maharashtra, India Seaspan Corporation Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Seaspan teams are goal-driven and share a high-performance culture, focusing on building services offerings to become a leading asset manager. Seaspan provides many of the world's major shipping lines with alternatives to vessel ownership by offering long-term leases on large, modern containerships and pure car, truck carriers (PCTCs) combined with industry...

  • Databricks Developer

    1 week ago

    Mumbai, Maharashtra, India Stanra Tech Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title : Databricks Developer (Contract) Contract Duration : 4 Months +Exendible based on Performance Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal...