Cloud Databricks Operations Specialist

3 days ago

Hyderabad, Telangana, India beBeeDatabricks Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Summary:

We are seeking a highly skilled Databricks professional to join our team. As a Cloud Databricks Administrator, you will be responsible for ensuring the optimal performance and reliability of our Databricks environments.

In this role, you will work closely with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks. Your expertise in Databricks and Apache Spark will enable you to proactively monitor system health, resource utilization, and performance metrics.

You will also be responsible for implementing and enforcing archival/retention policies for Databricks storage to optimize costs and performance. Additionally, you will support CI/CD pipelines and automate repetitive operational tasks.

This is an exciting opportunity for a motivated individual who is passionate about cloud computing and data engineering. If you have a strong background in SRE or production support environments, we encourage you to apply.

Key Responsibilities:
  • Monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
Requirements:
  • 3+ years of hands-on experience with Databricks and Apache Spark in production environments.
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.
  • Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira).
  • Proficiency in Python or Scala for data processing and automation.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash).
  • Understanding of cloud cost optimization and usage tracking.
  • Excellent problem-solving skills, communication, and cross-team collaboration abilities.

  • Cloud Databricks Operations Specialist

    2 weeks ago

    Hyderabad, Telangana, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OpportunityOur organization is seeking a skilled Cloud Databricks Administrator to join our Engineering team. This role will play a key part in operational support, defect management, and proactive issue resolution to keep data pipelines running smoothly.Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize...

  • Databricks Data Operations Specialist

    3 days ago

    Hyderabad, Telangana, India beBeeDataOperations Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a Data Operations Specialist, you will play a crucial role in ensuring the reliability and efficiency of our Databricks platform. Your primary responsibility will be to oversee the monitoring and maintenance of Databricks jobs, identify and troubleshoot issues, and implement fixes to minimize downtime.Key responsibilities include:Monitoring...

  • Databricks Administrator

    1 week ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Databricks Administrator

    5 days ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Databricks Developer

    4 weeks ago

    Hyderabad, Telangana, India Wipro Full time

    xefxbfxbd Responsibilities will include designing implementing and maintaining the Databricks platform and providing operational support Operational support responsibilities include platform set-up and configuration workspace administration resource monitoring providing technical support to data engineering Data Science ML and Application...

  • Databricks Infrastructure Specialist

    2 days ago

    Hyderabad, Telangana, India beBeeinfrastructure Full time ₹ 25,00,000 - ₹ 40,00,000

    Job Title: Databricks Infrastructure SpecialistWe are seeking a highly skilled Databricks Infrastructure Specialist to assess and improve our Databricks implementation on Azure, integrating it with AzureDevOps.This role involves conducting a thorough audit of the current Databricks implementation on Azure, identifying areas for improvement.The successful...

  • Azure Databricks Administrator

    7 days ago

    Hyderabad, Telangana, India EverestDX Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Databricks Engineer

    6 days ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Databricks Architect

    6 days ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • 15h Left Databricks Administrator

    2 weeks ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...