Cloud Databricks Operations Specialist

2 days ago

Hyderabad, Telangana, India beBeeDatabricks Full time ₹ 15,00,000 - ₹ 25,00,000
Job Opportunity

Our organization is seeking a skilled Cloud Databricks Administrator to join our Engineering team. This role will play a key part in operational support, defect management, and proactive issue resolution to keep data pipelines running smoothly.

  • Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
  • Maintain technical documentation, SOPs, and runbooks for Databricks operations.
  • Evaluate security compliance with RBAC, MFA, and encryption best practices.
Key Qualifications
  • Hands-on experience with Databricks and Apache Spark in production environments.
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.
  • Experience in SRE or production support environments with SLAs and ticketing systems.
  • Proficiency in Python or Scala for data processing and automation.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages.
  • Understanding of cloud cost optimization and usage tracking.
Preferred Qualifications
  • Experience with Databricks Lakehouse/Madelaine architecture.
  • Background in monitoring, logging, and incident response for data platforms.
  • Exposure to Kubernetes, Docker, and Terraform.
Required Skills
  • Bachelor's degree in Computer Science, IT, or equivalent professional experience.
  • 5+ years in data engineering, cloud operations, or database administration.
  • Proven ability to troubleshoot, communicate effectively, and collaborate across teams in a fast-paced environment.

  • Databricks Developer

    3 weeks ago

    Hyderabad, Telangana, India Wipro Full time

    xefxbfxbd Responsibilities will include designing implementing and maintaining the Databricks platform and providing operational support Operational support responsibilities include platform set-up and configuration workspace administration resource monitoring providing technical support to data engineering Data Science ML and Application...

  • Azure Databricks Architect

    4 weeks ago

    Hyderabad, Telangana, India ValueMomentum Full time

    Job Description- Develop modern data solutions and architecture for cloud-native data platforms.- Build cost-effective infrastructure in Databricks and orchestrate workflows using Databricks/ADF.- Lead data strategy sessions focused on scalability, performance, and flexibility.- Build CI/CD pipelines for Databricks in Azure DevOps.- Collaborate with...

  • 15h Left Databricks Administrator

    2 days ago

    Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Aws + Databricks

    3 weeks ago

    Hyderabad, Telangana, India CIEL HR Full time

    Exp - 10 yearsLocation - PAN IndiaProven experience with Databricks Python Spark SparkSQL and AWSxc2xb7 Databricks Certification Data Engineer Associate preferredxc2xb7 Experience of Migration to Databricks from traditional cloud warehousesxc2xb7 Take Ownership and can perform as an individual contributorxc2xb7 Good understanding on Databricks Setup will...

  • Databricks Developer

    3 days ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

  • Databricks Infrastructure Specialist

    5 days ago

    Hyderabad, Telangana, India beBeeAdministrative Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Databricks Platform Admin to join our team. As a key member of our organization, you will be responsible for managing workspaces, AWS accounts, and high-level usage monitoring.You will have a deep understanding of Unity catalog and experience in optimizing usage for performance and cost.Experience with building...

  • Cloud Operations Specialist

    5 hours ago

    Hyderabad, Telangana, India beBeeCloudOperations Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Operations SpecialistOverviewWe are seeking a highly skilled and experienced Cloud Operations Specialist to join our organization. The ideal candidate will have a strong background in cloud infrastructure management, with expertise in AWS, Azure, and GCP platforms.Key ResponsibilitiesOversee and manage cloud operations to ensure seamless...

  • Databricks Engineer

    4 weeks ago

    Hyderabad, Telangana, India Growel Softech Pvt. Ltd. Full time

    Description :We are looking for an experienced Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and a passion for working with big data :- Design and develop data pipelines using Databricks.- Collaborate with data engineers and data scientists to enhance data processing capabilities.-...

  • Cloud Operations Business Analyst

    7 hours ago

    Hyderabad, Telangana, India beBeeCloudCostManagement Full time US$ 9,00,000 - US$ 12,00,000

    Business Analytics Specialist - Cloud OperationsThis role focuses on driving process improvement and data-driven decision-making across enterprise operations, data platform engineering, and automation.The Business Analytics Specialist will contribute to the strategic vision of expanding cloud-based data entitlements by analyzing workflows and operational...

  • Azure Databricks Engineer/Technical Lead

    4 weeks ago

    Hyderabad, Telangana, India Infinity HR Solutions Full time

    Job Role : Senior Data Bricks EngineerType : Contract to hire (6 : Work from Office : Total 8+ Years (6+ years (Databricks, AWS) 4+ years (Apache spark, Title : Senior Databricks Engineer / Technical LeadJob Overview :We are looking for a Senior Databricks Engineer or Technical Lead with strong experience in cloud data platforms, particularly with...