Databricks lead

4 days ago

Bengaluru, Karnataka, India Recro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Designation - Databricks lead

Experience - 8+ Years

Key Responsibilities


• Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks.


• Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.


• Collaborate with stakeholders to translate businessrequirementsinto technical solutions.


• Oversee the migration of on-premises data systemsto Databricks cloud environments.


• Drive best practicesin data governance, security, and performance optimization.


• Provide technical leadership, mentorship, and support to data engineering teams.


• Work closely with data scientiststo productionize machine learning models.


• Establish monitoring, logging, and automated testing for data pipelines.


• Ensure compliance with industry standards,security protocols, and regulatory requirements.


• Evaluate new featuresin Databricks and recommend adoption strategies.

Required Skills & Qualifications


• Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.


• 8+ years of experience in data engineering, with 3+ years in Databricks.


• Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.


• Proven experience with Databricks on Azure, AWS, or GCP.


• Hands-on experience in designing large-scale ETL/ELT workflows.


• Proficiency in cloud storage (S3, ADLS, GCS) and data warehousing solutions (Snowflake, Redshift,

Synapse, BigQuery).


• Strong knowledge of DevOps, CI/CD, and Infrastructure as Code (Terraform/CloudFormation).


• Experience in MLflow, feature engineering, and integrating machine learning pipelines.


• Excellent communication, leadership, and stakeholder managementskills.


• Databricks certification(s) such as Databricks Certified Data Engineer Professional or Databricks

Certified Machine Learning Professional preferred.

Preferred Skills


• Experience with streaming technologies(Kafka, Event Hubs, Kinesis).


• Knowledge of data governance frameworks(Collibra, Purview).


• Familiarity with BI/visualization tools(Power BI, Tableau, Looker).

  • Databricks Lead

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Duties: Wyndham Group of Hotels is advancing its modern data platform on Databricks (AWS) and is seeking a senior offshore data engineering lead to build high-performance, production-grade data pipelines. This role is not migration-focused initially but will evolve into one. The current mandate is to ingest semi-structured JSON data dropped via SFTP to...

  • Sr. Technical Enablement Specialist

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...

  • Sr. Technical Enablement Specialist

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    FEQ426R542As a Senior Technical Enablement Specialist at Databricks, you will apply your expertise in enablement to lead the design of enablement programs for Databricks Technical Support Engineers. This will include curation of content and collaboration with SMEs and/or Technical Curriculum Developers. Programs in your portfolio can include onboarding and...

  • Director of Engineering

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    (P-1384)About The TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs.Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...

  • Senior Staff Software Engineer

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 60,00,000 per year

    Job Description (P-1174) We are hiring a Senior Staff Software Engineer for Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide.Key Characteristics As an executive engineering...

  • Senior Staff Software Engineer

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Staff Software Engineer (Backend) (P-1174) We are hiring a Senior Staff Software Engineer for Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide. Key Characteristics ...

  • Staff Software Engineer

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    (P-1174)We are hiring aSenior Staff Software Engineerfor Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide.Key CharacteristicsAs an executive engineering individual contributor at...

  • Director of Engineering

    4 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,50,00,000 - ₹ 2,50,00,000 per year

    Director of Engineering (Lakeflow) (P-1384) About the Team At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for...

  • Senior Staff Software Engineer

    3 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description (P-1174) We are hiring a Senior Staff Software Engineer for Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide.Key Characteristics As an executive engineering...

  • Senior Staff Software Engineer

    2 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Staff Software Engineer (Data Platform) (P-1174) We are hiring a Senior Staff Software Engineer for Databricks' Engineering team reporting to an Engineering Leader. You will be part of the Databricks engineering organization, working with teams that develop Databricks products and features for thousands of enterprises worldwide. Key Characteristics ...