Databricks lead

1 day ago

Bengaluru, Karnataka, India Recro Full time
Designation - Databricks lead

Experience - 8+ Years

Key Responsibilities

• Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks.

• Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.

• Collaborate with stakeholders to translate businessrequirementsinto technical solutions.

• Oversee the migration of on-premises data systemsto Databricks cloud environments.

• Drive best practicesin data governance, security, and performance optimization.

• Provide technical leadership, mentorship, and support to data engineering teams.

• Work closely with data scientiststo productionize machine learning models.

• Establish monitoring, logging, and automated testing for data pipelines.

• Ensure compliance with industry standards,security protocols, and regulatory requirements.

• Evaluate new featuresin Databricks and recommend adoption strategies.

Required Skills & Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, or related field.

• 8+ years of experience in data engineering, with 3+ years in Databricks.

• Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.

• Proven experience with Databricks on Azure, AWS, or GCP.

• Hands-on experience in designing large-scale ETL/ELT workflows.

• Proficiency in cloud storage (S3, ADLS, GCS) and data warehousing solutions (Snowflake, Redshift,

Synapse, BigQuery).

• Strong knowledge of DevOps, CI/CD, and Infrastructure as Code (Terraform/CloudFormation).

• Experience in MLflow, feature engineering, and integrating machine learning pipelines.

• Excellent communication, leadership, and stakeholder managementskills.

• Databricks certification(s) such as Databricks Certified Data Engineer Professional or Databricks

Certified Machine Learning Professional preferred.

Preferred Skills

• Experience with streaming technologies(Kafka, Event Hubs, Kinesis).

• Knowledge of data governance frameworks(Collibra, Purview).

• Familiarity with BI/visualization tools(Power BI, Tableau, Looker).

  • Databricks Lead

    1 day ago

    Bengaluru, Karnataka, India Genisys Group Full time

    Job SummaryDatabricks Lead is a senior role and expectation is that the ideal candidate should have minimum 10+ years of development hands-on experience.Key Skills & Qualifications:Databricks Expertise: Deep experience with the Databricks platform, including Spark, SQL, and data processing capabilities.Programming Languages: Proficiency in programming...

  • Director of Engineering

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...

  • Databricks Lead

    3 days ago

    Bengaluru, Karnataka, India Genisys Group Full time

    Job SummaryDatabricks Lead is a senior role and expectation is that the ideal candidate should have minimum 10+ years of development hands-on experience.Key Skills & Qualifications:Databricks Expertise: Deep experience with the Databricks platform, including Spark, SQL, and data processing capabilities.Programming Languages: Proficiency in programming...

  • Sr. Solutions Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our...

  • Sr. Solutions Engineer

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    FEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Solutions Architect

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    FEQ426R138As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Director of Engineering

    22 hours ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Partner Solutions Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ125R56As a Partner Solutions Architect (PSA) for India, you will work with Databricks&apos Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop &apostechnical champions&apos within our top C&SI Partners, providing enablement on...

  • Staff Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Lead Databricks Engineer

    9 hours ago

    Bengaluru, Karnataka, India DXC Technology Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Description:Lead Databricks Engineer / Architect Job Location: Hyderabad / Bangalore / Chennai / Kolkata / Noida/ Gurgaon / Pune / Indore / Mumbai Role OverviewWe are seeking an experienced Lead Data Engineer / Architect with over 10 years of industry experience (5+ years in Databricks and modern data platforms) to design, implement, and lead...