Databricks Platform Specialist

1 day ago

Pune, Maharashtra, India beBeeDatabricks Full time ₹ 20,00,000 - ₹ 25,00,000

Platform Configuration Expert

We are seeking a skilled Platform Configuration Expert to join our team and play a key role in managing and supporting Databricks environments across multiple clouds.

Main Responsibilities:

  • Databricks Management: Configure and manage Databricks workspaces for optimal performance and resource utilization.
  • Data Governance: Implement and oversee Databricks Unity Catalog to effectively organize, govern, and manage data assets, ensuring data quality and discoverability.
  • Access Control & Security: Set up and manage Role-Based Access Control (RBAC) to define granular user and group permissions within Databricks.
  • Azure Active Directory Integration: Integrate with Azure Active Directory (AD) groups for streamlined identity management.
  • Automation & API Integration: Leverage Databricks APIs and Service Principals to automate routine tasks, build custom integrations, and ensure secure programmatic access to the platform.
  • Networking & Cloud Connectivity: Configure and troubleshoot network connectivity (NCC) for Databricks on multiple clouds, ensuring seamless data flow and secure communication.
  • System Monitoring: Monitor Databricks systems and integrated cloud services for performance, availability, and potential issues, proactively addressing any anomalies.
  • Scripting & Automation: Write robust automation scripts using Python and PowerShell to streamline operational tasks and enhance platform efficiency.
  • Infrastructure as Code: Utilize Terraform to define, provision, and manage infrastructure components for Databricks environments, ensuring consistency and repeatability.
  • DevOps & CI/CD: Build, maintain, and optimize deployment pipelines using Azure DevOps to facilitate continuous integration and continuous deployment of platform configurations and applications.
  • Testing: Develop and implement unit tests and integration tests using Pytest to ensure the quality, reliability, and stability of platform code and configurations.

Required Skills & Qualifications:

  • Proven Experience: Proven experience as a Platform Engineer or similar role, with a strong focus on Databricks environments.
  • Unity Catalog Expertise: Hands-on expertise with Databricks Unity Catalog.
  • Access Control & Security Knowledge: Solid understanding and practical experience with access controls (RBAC), Databricks APIs, and Service Principals.
  • Azure Active Directory Integration: Experience integrating with Azure Active Directory (AD) groups.
  • Networking & Cloud Connectivity: Proficiency in configuring and troubleshooting network connectivity (NCC) on multiple clouds.
  • Scripting Skills: Strong scripting skills in Python and PowerShell.
  • Terraform Expertise: In-depth experience with Terraform for Infrastructure as Code.
  • DevOps & CI/CD: Demonstrated ability to build and manage deployment pipelines using Azure DevOps.
  • Testing: Experience in writing unit tests and integration tests using Pytest.
  • Cloud Platform Monitoring: Familiarity with monitoring tools and best practices for cloud platforms.

  • Databricks System Administrator

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Platform SpecialistJob Summary:We are seeking a highly skilled Data Platform Specialist to join our team. The ideal candidate will have expertise in managing large-scale data clusters, troubleshooting issues, and working with Databricks system tables.Responsibilities:Manage and maintain Databricks clusters and workspaces at scale.Troubleshoot...

  • Senior Databricks Unified Data Analytics Platform Specialist

    3 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,44,48,000 - ₹ 2,01,68,000

    Job DescriptionWe are seeking a skilled Application Developer to join our team. The ideal candidate will have expertise in Databricks Unified Data Analytics Platform and be able to design, build, and configure applications to meet business process and application requirements.A typical day involves collaborating with team members to understand project needs,...

  • Databricks Architect

    17 hours ago

    Pune, Maharashtra, India Bitwise Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    Bitwise Looking for Databricks Architect at Pune , Relevant Candidate please share resume on email ID - Experience: 10 to 15 yearsEmployment Type: Full-timeIndustry: IT Services and ConsultingStrong expertise in Databricks (Spark, Delta Lake, MLFlow, Workflows, Unity Catalog)Experience with cloud platforms: Azure, AWS, or GCPExpertise in Spark...

  • Databricks Developer

    19 hours ago

    Pune, Maharashtra, India LTIMindtree Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Role DescriptionJob SummaryAs a Databricks Developer, you will be responsible for developing, optimizing, and maintaining data pipelines and analytic workflows on Databricks. You will collaborate with data engineers, analysts, data scientists, and business stakeholders to transform raw data into actionable insights. This role requires hands-on expertise with...

  • Azure Databricks

    4 weeks ago

    Pune, Maharashtra, India Phygital Insights Private Limited Full time

    Job DescriptionDescriptionWe are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and be proficient in leveraging Azure Databricks to build robust data solutions.Responsibilities- Design and implement data pipelines using Azure Databricks to process large...

  • Databricks Engineer

    18 hours ago

    Pune, Maharashtra, India Bitwise Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role: DataBricks EngineerNotice Period: Immediate joiners onlyLocation: PuneWork Mode: HybridPosition Overview:We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a...

  • Capco - Azure Databricks Platform Engineer - Insurance Data Infrastructure

    2 days ago

    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Azure Databricks Platform Engineer - Insurance Data InfrastructureLocation : Pune / Bangalore/ Mumbai/ Chennai/ Hyderabad/ GurugramBand : M3/M4 (7 to 14 years)Key Responsibilities : - Azure Databricks Platform Engineering - Design, deploy, and manage secure, scalable, and high-performance Databricks environments for insurance data processing and analytics.-...

  • Databricks Data Engineer

    4 days ago

    Pune, Maharashtra, India beBeeData Full time US$ 1,25,000 - US$ 1,75,000

    We are seeking a skilled data engineer to design, develop and optimize data processing pipelines on the Databricks platform. Your primary responsibilities will include architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and performance of our data infrastructure.Key...

  • Databricks Architect

    20 hours ago

    Pune, Maharashtra, India ARA Resources Pvt. Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    About ARAs ClientARAs Client is a global leader in end-to-end data and analytics solutions with nearly two decades of experience in enabling organizations to derive business value from modern data capabilities. Operating with the scale of a global consulting firm and the depth of a niche partner, ARAs Client has delivered cutting-edge data modernization,...

  • Azure Databricks Data Ingestion Expert

    6 days ago

    Pune, Maharashtra, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Overview:Azure Databricks Data Ingestion SpecialistWe are seeking a highly skilled Data Ingestion Specialist with expertise in CI/CD and Kubernetes to join our team. This role requires a strong understanding of data ingestion processes, focusing on integrating various data sources into Databricks.Design, develop, and optimize data ingestion pipelines for...