Cloud Databricks Administrator

7 days ago

Hyderabad, Telangana, India EverestDX Full time ₹ 1,00,00,000 - ₹ 1,50,00,000 per year

We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team.

In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.

You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running smoothly.

Key Responsibilities :

- Monitor hourly and daily Databricks jobs, investigate failures, and implement fixes to minimize downtime.

- Identify, log, and track defects/bugs through ticketing systems, ensuring timely resolution.

- Manage Databricks access via Azure AD groups with Admin, Edit, and Read permissions.

- Provide production support for Databricks environments, including cluster operations, job failures, and notebook troubleshooting.

- Collaborate with data engineers and platform teams to resolve platform-related incidents and performance bottlenecks.

- Proactively monitor system health, resource utilization, and performance metrics.

- Implement and enforce archival/retention policies for Databricks storage to optimize costs and performance.

- Support CI/CD pipelines (Jenkins, Azure Automation) and automate repetitive operational tasks.

- Maintain technical documentation, SOPs, and runbooks for Databricks operations.

- Ensure security compliance with RBAC, MFA, and encryption best practices.

Preferred Qualifications :

- 3+ years of hands-on experience with Databricks and Apache Spark in production environments.

- Strong knowledge of Azure (AWS/GCP acceptable) and cloud-native services.

- Experience in SRE or production support environments with SLAs and ticketing systems (ServiceNow, Jira).

- Proficiency in Python or Scala for data processing and automation.

- Familiarity with Power BI/Tableau for building monitoring and cost dashboards.

- Knowledge of CI/CD tools, version control (Git), and scripting languages (PowerShell, Bash).

- Understanding of cloud cost optimization and usage tracking.

- Excellent problem-solving skills, communication, and cross-team collaboration abilities.

Nice to Have :

- Experience with Databricks Lakehouse/Madelaine architecture.

- Background in monitoring, logging, and incident response for data platforms.

- Exposure to Kubernetes, Docker, and Terraform.

Required Skills :

- Bachelors degree in Computer Science, IT, or equivalent professional experience.

- 5+ years in data engineering, cloud operations, or database administration.

- Proven ability to troubleshoot, communicate effectively, and collaborate across teams in a fast-paced environment

  • EverestDX - Cloud Databricks Administrator - Docker/Kubernetes

    7 days ago

    Hyderabad, Telangana, India EverestDX Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a Cloud Databricks Administrator to join our Cloud Engineering team.In this role, you will monitor and maintain Databricks jobs, troubleshoot issues, ensure platform reliability, and manage access controls.You will play a key part in operational support, defect management, and proactive issue resolution to keep our data pipelines running...

  • Senior Databricks Administrator

    5 days ago

    Hyderabad, Telangana, India Sonatype Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionKey Responsibilities :User Provisioning And ManagementOnboard and offboard users, groups, and service principals within Databricks, including integration with identity providers (IdPs) like Azure Active Directory or Okta via SCIM.Manage user roles and entitlements at both the account and workspace levels (Account Admins, Workspace Admins,...

  • Sonatype - Senior Databricks Administrator

    5 days ago

    Hyderabad, Telangana, India sonatype Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Key Responsibilities : User Provisioning and Management : - Onboard and offboard users, groups, and service principals within Databricks, including integration with identity providers (IdPs) like Azure Active Directory or Okta via SCIM. - Manage user roles and entitlements at both the account and workspace levels (Account Admins,...

  • Databricks Architect

    2 weeks ago

    Hyderabad, Telangana, India Paltech Consulting Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Key Responsibilities:Design and develop the migration strategies and processesCollaborate with stakeholders to understand business requirements and technical challenges.Analyze current data and scope for optimization during the migration process.Define the architecture and roadmap for cloud-based data and analytics transformation on Databricks.Design,...

  • Databricks

    2 weeks ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

  • Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Databricks Developer

    2 weeks ago

    Hyderabad, Telangana, India Zetamicron Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

  • Databricks with Python

    5 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role - Databricks with PythonExp - 5 to 9 YrsLocation - HyderabadNote - This is a scheduled drive. Only eligible candidates who receive invite from us will be allowed inside Campus.Job DescriptionExtensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and...

  • Databricks Engineer

    1 week ago

    Hyderabad, Telangana, India ValueMomentum Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionValueMomentum is a leading solutions provider for the global property and casualty insurance industry, backed by deep domain and technology capabilities. Our mission is to help insurers achieve sustained growth and high performance by enhancing stakeholder value and building resilient societies. Trusted by over 100 insurers globally, we...

  • Cloud Administrator

    2 weeks ago

    Hyderabad, Telangana, India NexGenAI Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Should have Min of 6 years experience with a qualification in BE or BTech degree in Computer Science or computer engineering or software engineering or Information technology or Electronics & telecommunication or Instrumentation engineering or in similar branch OR MCA degree.Essential Certification: Certification in cloud - Azure /AWS /GCP/MeitY...