EverestDX - Cloud Databricks Administrator - Docker/Kubernetes

6 days ago

Hyderabad, Telangana, India EverestDX Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team.

In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.

You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running smoothly.

Key Responsibilities

  • Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.
  • Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.
  • Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.
  • Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.
  • Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.
  • Proactively monitor system health, resource utilization, and performance metrics.
  • Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.
  • Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.
  • Maintain technical documentation, SOPs, and runbooks for Databricks operations.
  • Ensure security compliance with RBAC, MFA, and encryption best practices.

Preferred Qualifications

  • 3+ years of hands-on experience with Databricks and Apache Spark in production environments.
  • Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.
  • Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira).
  • Proficiency in Python or Scala for data processing and automation.
  • Familiarity with Power BI/Tableau for building monitoring and cost dashboards.
  • Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash).
  • Understanding of cloud cost optimization and usage tracking.
  • Excellent problem-solving skills, communication, and cross-team collaboration abilities.

Nice To Have

  • Experience with Databricks Lakehouse/Madelaine architecture.
  • Background in monitoring, logging, and incident response for data platforms.
  • Exposure to Kubernetes, Docker, and Terraform.

Required Skills

  • Bachelors degree in Computer Science, IT, or equivalent professional experience.
  • 5+ years in data engineering, cloud operations, or database administration.
  • Proven ability to troubleshoot, communicate effectively, and collaborate across teams in a fast-paced environment

)

  • EverestDX - Informatica Administrator

    1 week ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About The CompanyEverest DX - We are a Digital Platform Services company, headquartered in Stamford. Our Platform/Solution includes Orchestration, Intelligent operations with BOTs, AI-powered analytics for Enterprise IT.Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and actionable...

  • Senior Cloud Engineer-Kubernetes

    1 week ago

    Hyderabad, Telangana, India Optimhire IT Solutions Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role : Principal/Senior Cloud Engineer-KubernetesLocation : HyderabadWorking Shift : 5 Days/ General shiftOverall; Experience : 4+ yearsMust have skills :KubernetesCloud ComputingAgile Software DevelopmentDockerNotice Period : Immediate to 15 Days

  • Senior Databricks Administrator

    4 days ago

    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionKey Responsibilities :User Provisioning And ManagementOnboard and offboard users, groups, and service principals within Databricks, including integration with identity providers (IdPs) like Azure Active Directory or Okta via SCIM.Manage user roles and entitlements at both the account and workspace levels (Account Admins, Workspace Admins,...

  • Senior Cloud Engineer-Kubernetes//Golang

    4 days ago

    Hyderabad, Telangana, India Optimhire IT Solutions Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionPrincipal/Senior Cloud Engineer-KubernetesIndia,HyderabadFull timeJob DescriptionUnderstand the design specifications.​Follow the best practices for cloud container management on K8SKubernetes(k8s) Operator with Product CRDK8S rolling upgrade, backup restore, automatic failoverK8S scaling (horizontal/vertical), monitoring/alertingK8S storage...

  • Cloud Engineering Senior Advisor- HIH

    2 weeks ago

    Hyderabad, Telangana, India The Cigna Group Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    We are seeking a highly skilled Databricks Platform Infrastructure and Admin Engineer with experience in GPU computing to join our team. The ideal candidate will have a strong background in managing and optimizing cloud-based data platforms, with a focus on Databricks and GPU acceleration. The Databricks Platform Infrastructure and Admin Engineer will be...

  • Principal / Senior Cloud Engineer – Kubernetes

    2 weeks ago

    Hyderabad, Telangana, India Infonyx Solutions LLC Full time ₹ 26,00,000 per year

    Principal / Senior Cloud Engineer – KubernetesJob DescriptionWe are seeking an experienced Principal/Senior Cloud Engineer – Kubernetes to design, build, and manage large-scale, distributed cloud-native systems. The role involves developing and managing Kubernetes operators, ensuring high availability, scaling, and resiliency of services, and driving...

  • EverestDX - Senior Frontend Developer - Framework

    4 days ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAbout the Company :Everest DX We are a Digital Platform Services company, headquartered in Stamford.Our Platform/Solution includes Orchestration, Intelligent operations with BOTs, AI-powered analytics for Enterprise IT.Our vision is to enable Digital Transformation for enterprises to deliver seamless customer experience, business efficiency and...

  • Cloud Operations Engineer

    2 weeks ago

    Hyderabad, Telangana, India Solix Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Role & responsibilitiesSupport and maintain Linux-based systems and Azure cloud environments.Deploy, monitor, and manage applications using Docker and Kubernetes.Assist in cloud infrastructure automation and scripting.Work with the DevOps and Engineering teams to ensure smooth application deployments.Troubleshoot system and network issues in cloud...

  • Lead Databricks Engineer

    3 days ago

    Hyderabad, Telangana, India Milestone Technologies, Inc. Full time ₹ 30,00,000 - ₹ 50,00,000 per year

    Role Overview:We are looking for a seasoned and visionary Lead Databricks Engineerwith over 14 years of experience to lead the design and implementation of enterprise-grade data architecture, governance frameworks, and scalable data platforms. This role requires deep expertise in modern data technologies, big data ecosystems, and cloud-native solutions. The...

  • System Administrator

    7 days ago

    Hyderabad, Telangana, India FIBLOC Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Infrastructure / Systems AdministratorRole Overview:Manage and secure FiBLOC's Linux-based blockchain and cloud infrastructure, ensuring high availability, reliability, and scalability for nodes, APIs, and services.Key Responsibilities:•  Deploy, monitor, and maintain blockchain nodes (testnet + mainnet).•  Administer Linux servers (Ubuntu/CentOS),...