Databricks Platform Specialist

4 weeks ago


Pune, Maharashtra, India Nilasu consulting Full time

Job Title: Databricks Administrator

Job Summary:

We are seeking a highly skilled Databricks Administrator to join our team at Nilasu Consulting. The successful candidate will be responsible for administering, configuring, and optimizing the Databricks platform to support data analytics, machine learning, and data engineering activities.

Key Responsibilities:

  • Administer, Configure, and Optimize Databricks Platform: Ensure the Databricks platform is properly configured and optimized to meet the needs of data analytics, machine learning, and data engineering activities.
  • Create, Manage, and Configure Databricks Workspaces: Create and manage Databricks workspaces to organize and collaborate on projects.
  • Provision, Manage, and Scale Databricks Clusters: Provision, manage, and scale Databricks clusters to meet computational needs and optimize resource utilization.
  • Manage User Accounts, Permissions, and Access Controls: Manage user accounts, permissions, and access controls to ensure data security and compliance.
  • Monitor Platform Performance and Identify Bottlenecks: Monitor platform performance, identify bottlenecks, and implement optimizations to improve efficiency.
  • Collaborate with Data Engineers: Collaborate with data engineers to integrate Databricks with various data sources and systems.
  • Integrate Databricks into CI/CD Pipelines: Integrate Databricks into CI/CD pipelines to automate data processing and model deployment.
  • Implement and Enforce Security Policies: Implement and enforce security policies, access controls, and encryption mechanisms to protect sensitive data.
  • Monitor and Manage Platform Costs: Monitor and manage platform costs, including optimizing resource utilization and controlling expenses.
  • Provide Technical Support: Provide technical support to Databricks users, including troubleshooting and issue resolution.
  • Maintain Detailed Documentation: Maintain detailed documentation of Databricks configurations, procedures, and best practices.

Requirements:

  • 3-5 Years of Experience in Data Engineering or Related Field: The successful candidate will have 3-5 years of experience in data engineering or a related field.
  • Strong Understanding of Databricks Architecture: The candidate will have a strong understanding of Databricks architecture, components, and features.
  • Proficiency in Python, Scala, or Other Programming Languages: The candidate will be proficient in Python, Scala, or other programming languages used with Databricks.
  • Experience with Cloud Platforms: The candidate will have experience with cloud platforms, such as AWS, Azure, or GCP.
  • Knowledge of Data Warehousing and Data Lake Concepts: The candidate will have knowledge of data warehousing and data lake concepts.
  • Experience with Data Integration and ETL Tools: The candidate will have experience with data integration and ETL tools.
  • Strong Analytical and Problem-Solving Skills: The candidate will have strong analytical and problem-solving skills.
  • Excellent Communication and Interpersonal Skills: The candidate will have excellent communication and interpersonal skills.
  • Ability to Work Independently and as Part of a Team: The candidate will be able to work independently and as part of a team.


  • Pune, Maharashtra, India Nilasu consulting Full time

    Job DescriptionRole Summary: We are seeking a highly skilled Databricks Administrator to join our team at Nilasu Consulting. The ideal candidate will have a strong understanding of Databricks architecture, components, and features, as well as proficiency in Python, Scala, or other programming languages used with Databricks.Key Responsibilities:Administer,...


  • Pune, Maharashtra, India Quess Full time

    Job Overview : Quess is seeking a highly skilled Databricks Administrator to join our Cloud Data Platform team. As a Databricks Administrator, you will play a crucial role in designing, implementing, and maintaining our data platform using Databricks on the Microsoft Azure cloud. Key Responsibilities : Manage and administer the Databricks platform,...


  • Pune, Maharashtra, India Quess Full time

    Job OverviewThe CFT Cloud Data Platform team is an Enterprise Project team that manages the Cloud data platform and builds system automation, IAM Role Access Management, System and Network Security, Platform Infrastructure, Feature release management, and self-service module tasks around the platform. We are seeking a skilled Databricks Administrator to join...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Job Overview:We are seeking a highly skilled Data Platform Engineer to join our CFT Cloud Data Platform team. This team is responsible for managing and administering the Cloud Data Platform, focusing on Azure Data Bricks and Snowflake. The role involves overseeing system automation, IAM role access management, system and network security, platform...


  • Pune, Maharashtra, India Erobern Consulting Full time

    Job Title: Azure Databricks LeadAs a key member of our team at Erobern Consulting, you will play a critical role in designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will contribute to building robust data pipelines, ensuring data quality, and enhancing overall performance.Responsibilities:Design and Develop Data...


  • Pune, Maharashtra, India Evoke HR Solutions Pvt. Ltd. Full time

    Job Title: Pyspark Lead / Databricks LeadAbout the Role: We are seeking an experienced Pyspark Lead / Databricks Lead to join our team at Evoke HR Solutions Pvt. Ltd. As a Pyspark Lead / Databricks Lead, you will be responsible for leading the development and implementation of Pyspark and Databricks solutions.Key Responsibilities:Lead the development and...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databrick AdministratorJob Summary:Greetings from Maneva Consulting Pvt. Ltd. We are seeking a highly skilled Databricks administrator to join our team. As a key member of our data engineering team, you will be responsible for managing and maintaining our Databricks environment on AWS.Key Responsibilities:Efficiently manage AWS cloud...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databrick Systems EngineerWe are looking for a highly skilled Databrick Systems Engineer to join our team at Mevane Consulting Pvt. Ltd.Key Responsibilities:Efficiently manage AWS cloud infrastructure and Databricks environment to ensure seamless operations.Conduct regular performance optimization and scaling of Databricks clusters on AWS to meet...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databricks Cloud Infrastructure ManagerAbout the Role:We are seeking a highly skilled Databricks Cloud Infrastructure Manager to join our team at Maneva Consulting Pvt. Ltd. As a key member of our infrastructure team, you will be responsible for managing and maintaining our Databricks environment on AWS, ensuring seamless operations and optimal...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Greetings from Maneva Consulting Pvt. Ltd.Job SummaryWe are seeking a highly skilled Senior Databrick System Administrator to join our team at Maneva Consulting Pvt. Ltd. The ideal candidate will have in-depth expertise in managing Databrick environments, AWS cloud infrastructure, and optimizing performance.Key ResponsibilitiesEfficiently manage AWS cloud...


  • Pune, Maharashtra, India Genpact Full time

    Unlock Data-Driven Insights with Our Senior Databricks Developer Lead RoleWe are seeking an experienced Senior Databricks Developer Lead to join our team at Genpact, a global professional services and solutions firm. As a key member of our data engineering team, you will be responsible for solving real-world cutting-edge problems and driving business value...


  • Pune, Maharashtra, India Talent Shark Full time

    Job Title: Data Management Platform Operations SpecialistWe are seeking an experienced and detail-oriented Data Engineer to join our dynamic team at Talent Shark. The ideal candidate will have a solid foundation in data management, SQL, and Python, and will be responsible for managing and optimizing large-scale data platforms. This role involves hands-on...


  • Pune, Maharashtra, India Talent Shark Full time

    Job Title: Data Management Platform Operations SpecialistWe are seeking an experienced and detail-oriented professional to join our dynamic team as a Data Management Platform Operations Specialist. The ideal candidate will have a solid foundation in data management, SQL, and Python, and will be responsible for managing and optimizing large-scale data...

  • Data Architect

    1 month ago


    Pune, Maharashtra, India RS Consultants Full time

    Job Title : Data Architect Location : Pune Experience Level : 6+ Years Company Type : AI/ML startup.Please apply only if you are comfortable working with Early stage startup. Job Description : We are seeking a Data Architect to design and oversee the development of scalable, high-performance data systems. In this role, you will leverage your expertise in the...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Overview:We are seeking a highly skilled Cloud Data Platform Engineer to join our CFT Cloud Data Platform team. This team is responsible for managing and administering the Cloud Data Platform focusing on Azure Data Bricks and Snowflake. The role involves overseeing system automation, IAM role access management, system security, platform infrastructure,...

  • Data Scientist

    4 weeks ago


    Pune, Maharashtra, India Synechron Full time

    Job Title: Data Scientist - Databricks and Cloud ExpertPosition Overview: At Synechron, we are seeking a skilled data scientist to play a key role in our data initiatives, particularly focusing on our migration journey from Azure to the Google Cloud Platform (GCP). The ideal candidate will have a solid background in data engineering technologies such as...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Job OverviewWe are seeking a highly skilled Cloud Data Platform Engineer to join our team at Overture Rede Private Limited. This role involves overseeing the entire infrastructure around the Data Platform, including Azure Data Bricks and Snowflake, and ensuring seamless system automation, secure access management, and efficient infrastructure solutions.Key...


  • Pune, Maharashtra, India KPI Partners Full time

    KPI Partners is a leading company in the industry, offering competitive salaries to its employees. We are currently hiring for the position of Data Engineering Specialist - Cloud Infrastructure.Job DescriptionAs a Data Engineering Specialist, you will be responsible for designing and implementing data migration and processing using Azure services, Serverless...


  • Pune, Maharashtra, India Virtusa Full time

    Senior Data Platform SpecialistWe are seeking an experienced Senior Data Platform Specialist to join our team. As a key member of our data team, you will be responsible for developing and maintaining data models, transformations, and SQL queries within the DBT framework. Your expertise in AWS services, including S3, Glue, and Redshift, will be crucial in...

  • AWS Data Engineer

    1 month ago


    Pune, Maharashtra, India Exusia Full time

    Job Title: Data Warehouse Engineer - AWS & Snowflake SpecialistJob Summary: Exusia is seeking a highly skilled Data Warehouse Engineer to join our global delivery team's Industry Analytics practice in India. The ideal candidate will have a minimum of 6 years' experience in Data engineering & Analytics space with hands-on project experience using Snowflake &...