EverestDX - Cloud Databricks Administrator - Docker/Kubernetes

7 days ago

Hyderabad, Telangana, India EverestDX Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team.

In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.

You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running smoothly.

Key Responsibilities

  • Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
  • Maintain technical documentation, SOPs, and runbooks for Databricks operations.
  • Ensure security compliance with RBAC, MFA, and encryption best practices.

Preferred Qualifications

  • 3+ years of hands-on experience with Databricks and Apache Spark in production environments.
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.
  • Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira).
  • Proficiency in Python or Scala for data processing and automation.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash).
  • Understanding of cloud cost optimization and usage tracking.
  • Excellent problem-solving skills, communication, and cross-team collaboration abilities.

Nice To Have

  • Experience with Databricks Lakehouse/Madelaine architecture.
  • Background in monitoring, logging, and incident response for data platforms.
  • Exposure to Kubernetes, Docker, and Terraform.

Required Skills

  • Bachelors degree in Computer Science, IT, or equivalent professional experience.
  • 5+ years in data engineering, cloud operations, or database administration.
  • Proven ability to troubleshoot, communicate effectively, and collaborate across teams in a fast-paced environment

)

  • Cloud Databricks Administrator

    6 days ago

    Hyderabad, Telangana, India EverestDX Full time ₹ 1,00,00,000 - ₹ 1,50,00,000 per year

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team. In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls. You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines...

  • EverestDX - Informatica Administrator

    1 week ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About The CompanyEverest DX - We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs, AI-powered analytics for Enterprise IT.Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable...

  • EverestDX - Cloud FinOps Engineer - AWS/Azure

    2 weeks ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionWe are looking for a Cloud FinOps Engineer to join our Cloud Engineering team and drive financial accountability across our cloud platforms (Azure, AWS, GCP, Datadog, MongoDB Atlas, and other engineering tools).You will be responsible for monitoring cloud usage, optimizing costs, enforcing governance controls, and enabling engineering teams to...

  • System Administrator with Kubernetes

    3 weeks ago

    Hyderabad, Telangana, India, Telangana TekVizion Full time

    Job Description: System Administrator (with Strong Kubernetes Expertise)Position OverviewWe are seeking an experienced System Administrator with deep expertise in Kubernetes and modern infrastructure management. The ideal candidate will be responsible for ensuring the stability, scalability, and security of our infrastructure across on-premises and cloud...

  • EverestDX - Java Full Stack Application Developer - Spring Boot/AngularJS

    24 hours ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking an experienced Java Full Stack Application Developer to design, develop, and maintain enterprise-grade applications.The ideal candidate will be proficient in both backend development (Java, Spring Boot, REST APIs) and frontend development (Angular/React, JavaScript, HTML, CSS).You will work in a collaborative environment, building...

  • Senior Cloud Engineer-Kubernetes

    1 week ago

    Hyderabad, Telangana, India Optimhire IT Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Principal/Senior Cloud Engineer-KubernetesLocation : HyderabadWorking Shift : 5 Days/ General shiftOverall; Experience : 4+ yearsMust have skills :KubernetesCloud ComputingAgile Software DevelopmentDockerNotice Period : Immediate to 15 Days

  • Senior Databricks Administrator

    5 days ago

    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionKey Responsibilities :User Provisioning And ManagementOnboard and offboard users, groups, and service principals within Databricks, including integration with identity providers (IdPs) like Azure Active Directory or Okta via SCIM.Manage user roles and entitlements at both the account and workspace levels (Account Admins, Workspace Admins,...

  • Databricks Solution Architect

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role: Databricks Solution ArchitectLocation: Kolkata ,Chennai, Kochi (Preferred), Hyderabad, Pune, Bangalore & MumbaiMode: Full TimeRequired Skills:Experience 10 + yearsExperience with machine learning frameworks and pipelines, particularly in Databricks.Familiarity with containerized environments (e.g., Docker, Kubernetes) for deploying data...

  • Kubernetes Developer

    1 day ago

    Hyderabad, Telangana, India Saika Technologies Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Required Skills & Experience10+ years of industry experience in cloud infrastructure, container orchestration, and DevSecOps. 4+ years of hands-on experience with Kubernetes in production environments. Strong knowledge of Kubernetes security, RBAC, Network Policies, and admission controllers. Experience in multi-cloud environments (Azure, AWS preferred)....

  • Magellanic Cloud

    2 weeks ago

    Hyderabad, Telangana, India Magellanic-Cloud Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job DescriptionKey Responsibilities :Design, build, and deploy machine learning models to solve real-world business problems.Perform data preprocessing, cleansing, transformation, and feature engineering on both structured and unstructured data.Train, evaluate, and optimize ML models for performance, scalability, and accuracy.Integrate ML models into...