EverestDX - Cloud Databricks Administrator - Docker/Kubernetes

15 hours ago


Hyderabad, Telangana, India EverestDX Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team.

In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.

You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running smoothly.

Key Responsibilities

  • Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
  • Maintain technical documentation, SOPs, and runbooks for Databricks operations.
  • Ensure security compliance with RBAC, MFA, and encryption best practices.

Preferred Qualifications

  • 3+ years of hands-on experience with Databricks and Apache Spark in production environments.
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.
  • Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira).
  • Proficiency in Python or Scala for data processing and automation.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash).
  • Understanding of cloud cost optimization and usage tracking.
  • Excellent problem-solving skills, communication, and cross-team collaboration abilities.

Nice To Have

  • Experience with Databricks Lakehouse/Madelaine architecture.
  • Background in monitoring, logging, and incident response for data platforms.
  • Exposure to Kubernetes, Docker, and Terraform.

Required Skills

  • Bachelors degree in Computer Science, IT, or equivalent professional experience.
  • 5+ years in data engineering, cloud operations, or database administration.
  • Proven ability to troubleshoot, communicate effectively, and collaborate across teams in a fast-paced environment

)



  • Hyderabad, Telangana, India EverestDX Full time ₹ 1,00,00,000 - ₹ 1,50,00,000 per year

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines...


  • Hyderabad, Telangana, India EverestDX Inc Full time

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...


  • Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About The CompanyEverest DX - We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs, AI-powered analytics for Enterprise IT.Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable...


  • Hyderabad, Telangana, India EverestDX Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionWe are looking for a Cloud FinOps Engineer to join our Cloud Engineering team and drive financial accountability across our cloud platforms (Azure, AWS, GCP, Datadog, MongoDB Atlas, and other engineering tools).You will be responsible for monitoring cloud usage, optimizing costs, enforcing governance controls, and enabling engineering teams to...


  • Hyderabad, Telangana, India TekVizion Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description: System Administrator (with Strong Kubernetes Expertise)Position OverviewWe are seeking an experienced System Administrator with deep expertise in Kubernetes and modern infrastructure management. The ideal candidate will be responsible for ensuring the stability, scalability, and security of our infrastructure across on-premises and cloud...


  • Hyderabad, Telangana, India People Prime Worldwide Full time

    About Client Our client is a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies Powered by more than 84 000 entrepreneurial professionals across more than 30 countries it caters to over 700 clients with its extensive domain and technology...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Databricks Solution ArchitectLocation: Kolkata ,Chennai, Kochi (Preferred), Hyderabad, Pune, Bangalore & MumbaiMode: Full TimeRequired Skills:Experience 10 + yearsExperience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.g., Docker, Kubernetes) for deploying data...


  • Hyderabad, Telangana, India Optimhire IT Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Principal/Senior Cloud Engineer-KubernetesLocation : HyderabadWorking Shift : 5 Days/ General shiftOverall; Experience : 4+ yearsMust have skills :KubernetesCloud ComputingAgile Software DevelopmentDockerNotice Period : Immediate to 15 Days


  • Hyderabad, Telangana, India Avant Garde Full time US$ 1,00,000 - US$ 1,50,000 per year

    Do you have a passion for Kubernetes, cloud-native platforms, and distributed systemsWere looking for a Principal / Senior Cloud Engineer to design, develop, and manage cloud container orchestration for one of the worlds leading graph data science product companies.Roles & ResponsibilitiesImplement cloud container management following best practices on...


  • Hyderabad, Telangana, India HYrEzy Tech Solutions Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Job Title: Principal / Senior Cloud Engineer – KubernetesLocation: Hyderabad (Work From Office)Experience: 4 – 7 YearsWork Model: Onsite (WFO only)Notice Period: 15-30 daysCompensation: 20 – 30 LPAAbout UsWe are a new-age, AI-first Digital & Cloud Engineering Services company. Our mission is to combine deep engineering expertise with automation-first...