Databricks Technical Lead

1 week ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 18,00,000

Job Title: Databricks Technical Lead

Job Description

We are seeking an experienced Databricks technical lead to join our team. The successful candidate will have a strong background in data engineering, with expertise in Apache Spark, PySpark, SQL, and Delta Lake.

The ideal candidate will have a proven track record of designing and implementing scalable data pipelines and ETL processes on Databricks. They will also have experience with cloud storage solutions such as S3, ADLS, and GCS, as well as data warehousing solutions like Snowflake, Redshift, Synapse, and BigQuery.

Additionally, the candidate should have a strong understanding of DevOps, CI/CD, and Infrastructure as Code (Terraform/CloudFormation). Experience with MLflow, feature engineering, and integrating machine learning pipelines is highly desirable.

As a Databricks technical lead, you will be responsible for architecting and optimizing big data and analytics solutions using Spark, Delta Lake, and MLflow. You will collaborate with stakeholders to translate business requirements into technical solutions and oversee the migration of on-premises data systems to Databricks cloud environments.

Key Responsibilities:

  • Design and implement scalable data pipelines and ETL processes on Databricks
  • Architect and optimize big data and analytics solutions using Spark, Delta Lake, and MLflow
  • Collaborate with stakeholders to translate business requirements into technical solutions
  • Oversee the migration of on-premises data systems to Databricks cloud environments
  • Drive best practices in data governance, security, and performance optimization
  • Provide technical leadership, mentorship, and support to data engineering teams
Required Skills & Qualifications

To be successful in this role, you will need:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or related field
  • 8+ years of experience in data engineering, with 3+ years in Databricks
  • Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake
  • Proven experience with Databricks on Azure, AWS, or GCP
  • Hands-on experience in designing large-scale ETL/ELT workflows
  • Proficiency in cloud storage (S3, ADLS, GCS) and data warehousing solutions (Snowflake, Redshift, Synapse, BigQuery)
  • Strong knowledge of DevOps, CI/CD, and Infrastructure as Code (Terraform/CloudFormation)
  • Experience in MLflow, feature engineering, and integrating machine learning pipelines
Benefits

This role offers a competitive salary and benefits package, including:

  • Comprehensive health insurance
  • Retirement savings plan
  • Flexible working hours
  • Professional development opportunities

  • Senior Technical Program Manager

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    P-1173At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Databricks Technical Lead

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDatabricks Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Databricks Leadership RoleThis senior leadership position involves overseeing Databricks-related projects and initiatives, leveraging extensive hands-on experience in development with at least 10+ years of expertise.Key Skills & Qualifications:Databricks Expertise: Proficiency in the Databricks platform, including Spark, SQL, and data processing...

  • Databricks lead

    3 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Designation - Databricks leadExperience - 8+ YearsKey Responsibilities• Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks.• Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.• Collaborate with stakeholders to translate businessrequirementsinto technical solutions.•...

  • Databricks lead

    1 week ago

    Bengaluru, Karnataka, India Recro Full time

    Job DescriptionDesignation - Databricks leadExperience - 8+ YearsKey ResponsibilitiesLead the design and implementation ofscalable data pipelines and ETL processes on Databricks.Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.Collaborate with stakeholders to translate businessrequirementsinto technical...

  • Databricks lead

    3 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Designation - Databricks lead Experience - 8+ Years Key Responsibilities • Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks. • Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow. • Collaborate with stakeholders to translate businessrequirementsinto technical solutions....

  • Databricks lead

    2 weeks ago

    Bengaluru, Karnataka, India Recro Full time

    Designation - Databricks leadExperience - 8+ YearsKey Responsibilities• Lead the design and implementation ofscalable data pipelines and ETL processes on Databricks.• Architect and optimize big data and analyticssolutions using Spark, Delta Lake, and MLflow.• Collaborate with stakeholders to translate businessrequirementsinto technical solutions.•...

  • Solutions Architect

    1 day ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    FEQ326R364As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Sr. Manager, Mid-Market

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,04,000 - US$ 1,30,878 per year

    SLSQ426R249We are looking for a Sr Manager of sales, Commercial & Mid-Market to join our sales organization. You will oversee and motivate a team of Account Executives, and you will be measured by your team's overall quota attainment, new business acquisition, and expansion into existing customer accounts. This is a team of motivated sellers, so we are...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    P- 1430At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Staff Software Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-1346At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...