Databricks Cloud Infrastructure Manager

17 hours ago


Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

Job Title: Databricks Cloud Infrastructure Manager

About the Role:

We are seeking a highly skilled Databricks Cloud Infrastructure Manager to join our team at Maneva Consulting Pvt. Ltd. As a key member of our infrastructure team, you will be responsible for managing and maintaining our Databricks environment on AWS, ensuring seamless operations and optimal performance.

Key Responsibilities:

  1. Manage and optimize Databricks clusters on AWS to meet evolving needs, including capacity planning.
  2. Integrate Azure DevOps or GitHub for robust CI/CD pipelines, including Delta Live Tables for real-time data processing.
  3. Automate deployment processes to enhance efficiency and reliability.
  4. Provide comprehensive support for ML and AI Chabot initiatives, understanding platform requirements for optimal client and data science team benefits.
  5. Facilitate the integration of ML models and Chabot functionalities within the Databricks environment.
  6. Skilfully create and configure new workspaces within the AWS environment, ensuring smooth setup and minimal vendor dependency.
  7. Proficiently write shell scripts for automation, leveraging Python and Scala for advanced scripting tasks.
  8. Implement robust access control mechanisms, configuring Databricks compute pools, service principles, groups, and roles.
  9. Implement stringent encryption measures for data stored in DBFS and AWS S3 buckets, utilizing AWS KMS for key management.
  10. Enforce strict access controls and security policies to protect against unauthorized access and data breaches.
  11. Configure comprehensive logging mechanisms to track system activities and user actions effectively, including utilizing AWS Cloud Trail for auditing and monitoring security events in real-time.
  12. Establish robust backup procedures, including regular backups of critical data and configurations.
  13. Implement versioning and lifecycle policies for data stored in S3 buckets to ensure data integrity and availability.
  14. Foster effective collaboration with cross-functional teams and application teams to support their requirements.
  15. Actively engage in knowledge sharing and contribute to the continuous improvement of the AWS Databricks environment and associated processes.


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databricks Cloud Infrastructure SpecialistJob Summary:Maneva Consulting Pvt. Ltd is seeking a highly skilled Databricks Cloud Infrastructure Specialist to manage and optimize our AWS cloud infrastructure and Databricks environment. The ideal candidate will have expertise in efficiently managing cloud infrastructure, conducting performance...


  • Pune, Maharashtra, India Quess Full time

    Project Overview : CFT Cloud Data Platform team is an Enterprise Project team which manages Cloud data platform (Azure Data Bricks and Snowflake) and build system automation, IAM Role Access Management, System and Network Security, Platform Infrastructure, Feature release management and self service module tasks around the platform.Job description :As a...


  • Pune, Maharashtra, India Quess Full time

    Job OverviewThe CFT Cloud Data Platform team is an Enterprise Project team that manages the Cloud data platform and builds system automation, IAM Role Access Management, System and Network Security, Platform Infrastructure, Feature release management, and self-service module tasks around the platform. We are seeking a skilled Databricks Administrator to join...


  • Pune, Maharashtra, India Quess Full time

    Job Title: Databricks AdministratorJob Summary:We are seeking an experienced Databricks Administrator to join our Cloud Data Platform team. The successful candidate will be responsible for designing, implementing, and maintaining our data platform using Databricks on the Microsoft Azure cloud.Key Responsibilities:Manage and administer the Databricks...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databricks AdministratorJob Summary:We are seeking a highly skilled Databricks Administrator to join our team at Maneva Consulting Pvt. Ltd. The successful candidate will be responsible for managing AWS cloud infrastructure and Databricks environment to ensure seamless operations.Key Responsibilities:Efficiently manage AWS cloud infrastructure and...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Job Title: Databricks AdministratorOverview:We are seeking a highly skilled Data Platform Engineer to join our CFT Cloud Data Platform team. This team is responsible for managing and administering the Cloud Data Platform, focusing on Azure Data Bricks and Snowflake. The role involves overseeing system automation, IAM role access management, system and...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Job Overview:We are seeking a highly skilled Data Platform Engineer to join our CFT Cloud Data Platform team. This team is responsible for managing and administering the Cloud Data Platform, focusing on Azure Data Bricks and Snowflake. The role involves overseeing system automation, IAM role access management, system and network security, platform...


  • Pune, Maharashtra, India Overture Rede Private Limited Full time

    Key Responsibilities:We are seeking a highly skilled Cloud Infrastructure Engineer to join our team at Overture Rede Private Limited. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our cloud infrastructure using Azure technologies.Key Skills:Minimum 35 years of hands-on experience with CI/CD,...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Synechron Full time

    Job Title: Data Engineer - Databricks and Cloud MigrationAt Synechron, we are seeking a skilled Data Engineer to play a key role in our data initiatives, particularly focusing on our migration journey from Azure to the Google Cloud Platform (GCP). The ideal candidate will have a solid background in data engineering technologies such as Databricks, SQL, and...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databricks AdminGreetings from Maneva Consulting Pvt. Ltd!Job DescriptionWe are seeking a highly skilled Databricks Admin to join our team. As a Databricks Admin, you will be responsible for efficiently managing AWS cloud infrastructure and Databricks environment to ensure seamless operations.Key Responsibilities:Conduct regular performance...


  • Pune, Maharashtra, India Merito Full time

    Cloud Administrator Job DescriptionAt Merito, we're seeking a skilled Cloud Administrator to manage our cloud infrastructure on Google Cloud Platform (GCP). As a key member of our team, you'll be responsible for ensuring the optimal performance, scalability, and reliability of our cloud infrastructure.Key Responsibilities:Manage and maintain cloud...


  • Pune, Maharashtra, India Merito Full time

    About Our ClientOur client is a pioneering Enterprise B2B SaaS startup based in Pune, India. They offer a cutting-edge Retail Media Operating System that empowers retailers to boost profitability by 7% of sales. With their innovative platform, retailers can activate and delight 10x more brands by providing an omni-channel media buying experience, advanced...


  • Pune, Maharashtra, India Vsynergize AI Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at Vsynergize AI. As a key member of our cloud infrastructure team, you will be responsible for designing, developing, and maintaining our cloud infrastructure across AWS, Azure, and GCP.Key Responsibilities:Design and implement cloud infrastructure solutions to meet...


  • Pune, Maharashtra, India Nilasu consulting Full time

    Job Title: Databricks AdministratorJob Summary:We are seeking a highly skilled Databricks Administrator to join our team at Nilasu Consulting. The successful candidate will be responsible for administering, configuring, and optimizing the Databricks platform to support data analytics, machine learning, and data engineering activities.Key...


  • Pune, Maharashtra, India Maneva Consulting Pvt. Ltd Full time

    Job Title: Databricks AdministratorJob Summary:We are seeking a highly skilled Databricks Administrator to join our team at Maneva Consulting Pvt. Ltd. The successful candidate will be responsible for managing and maintaining our Databricks environment, ensuring seamless operations and optimal performance.Key Responsibilities:Manage and maintain Databricks...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Job Title: Azure Databricks DeveloperWe are seeking a highly skilled Azure Databricks Developer to join our team at Tata Consultancy Services. As a key member of our team, you will be responsible for designing, developing, and implementing scalable and efficient data processing solutions using Azure Databricks.Key Responsibilities:Design and develop data...

  • Data Architect

    2 days ago


    Pune, Maharashtra, India RS Consultants Full time

    Job Title : Data Architect Location : Pune Experience Level : 6+ Years Company Type : AI/ML startup.Please apply only if you are comfortable working with Early stage startup. Job Description : We are seeking a Data Architect to design and oversee the development of scalable, high-performance data systems. In this role, you will leverage your expertise in the...


  • Pune, Maharashtra, India Nilasu consulting Full time

    Job Title: Databricks AdministratorJob Summary:We are seeking a highly skilled Databricks Administrator to join our team at Nilasu Consulting. The successful candidate will be responsible for administering, configuring, and optimizing the Databricks platform to support data analytics, machine learning, and data engineering activities.Key...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    We are seeking a skilled Azure Databricks Engineer to join our team at Tata Consultancy Services. The ideal candidate will have expertise in Azure Databricks (Core), Azure services (Admin), Cosmos DB, Pyspark, Python, SQL, SSIS, and ETL.Key Responsibilities:Propose optimized solutions and architecture for new/existing projectsCreate cost reports for existing...


  • Pune, Maharashtra, India Teradata Full time

    Cloud Infrastructure Engineer Location: Remote Job Summary: We are seeking a Cloud Infrastructure Engineer to join our team at Teradata. As a Cloud Infrastructure Engineer, you will be responsible for designing, implementing, and managing cloud infrastructure for our customers. You will work closely with our engineering team to ensure that our cloud...