Databrick Admin

3 months ago

Pune, India Maneva Consulting Pvt. Ltd Full time

GreetingsfromManeva

JobDescription

JobTitle DatabrickAdmin

LocationPune

Experience 5 10years

Shift8 am 5 pm EST 5:30 PM2:30AM

NoticeImmediate to 30Days

Requirements:

Efficiently manage AWS cloud infrastructure andDatabricks environment to ensure seamlessoperations.

Conduct regular performance optimization and scaling ofDatabricks clusters on AWS to meet evolving needs includes capacityplanning.

Seamlessly integrate Azure DevOps or GitHub for robustCI/CD pipelines including Delta Live Tables for realtime dataprocessing.

Automate deployment processes to enhance efficiency andreliability.

Provide comprehensive support for ML and AI Chabotinitiatives understanding platform requirements for optimal clientand data science teambenefits.

Facilitate the integration of ML models and Chabotfunctionalities within the Data bricksenvironment.

Skilfully create and configure new workspaces withinthe AWS environment ensuring smooth setup and minimal vendordependency.

Proficiently write shell scripts for automationleveraging Python and Scala for advanced scripting tasks isaddon.

Implement robust access control mechanisms configuringDatabricks compute pools service principles groups androles.

Implement stringent encryption measures for data storedin DBFS and AWS S3 buckets utilizing AWS KMS for keymanagement.

Enforce strict access controls and security policies toprotect against unauthorized access and databreaches.

Configure comprehensive logging mechanisms to tracksystem activities and user actions effectively includes utilizingAWS Cloud Trail for auditing and monitoring security events inrealtime.

Establish robust backup procedures including regularbackups of critical data andconfigurations.

Implement versioning and lifecycle policies for datastored in S3 buckets to ensure data integrity andavailability.

Foster effective collaboration with crossfunctionalteams and application teams to support theirrequirements.

Actively engage in knowledge sharing and contribute tothe continuous improvement of the AWS Databricks environment andassociatedprocesses.

Ifyou are excited to grab this opportunity please apply directly orshare your CV atand

  • Databricks Admin

    5 months ago

    Pune, Maharashtra, India Arting Digital Private Limited Full time

    Job Title: - Databricks Admin Experience: - 4+yr Location: - Remote Budget: - 12-15 lpa Education: - Any Primary skills: - Databricks Administrator,Apache Spark, Databricks architectur, cloud platforms, such as AWS, Azure, or Google Cloud **Requirements**: - Proven experience as a Databricks Administrator or in a similar role. - Strong knowledge...

  • Databricks Administrator

    2 months ago

    Pune, India Quess Full time

    Project Overview : CFT Cloud Data Platform team is an Enterprise Project team which manages Cloud data platform (Azure Data Bricks and Snowflake) and build system automation, IAM Role Access Management, System and Network Security, Platform Infrastructure, Feature release management and self service module tasks around the platform.Job description : As a...

  • Python

    2 months ago

    Pune, Maharashtra, India Cognizant Full time

    **Job summary** **Qualifications** - Possess strong technical skills in Python Amazon Redshift Amazon S3 PySpark Apache Airflow Databricks SQL and Spark in Scala. - Experience with Risk Management Databricks Workflows Structured Streaming Delta Live Pipelines Databricks CLI Databricks Unity Catalog Admin Databricks Delta Lake and Delta Sharing is a plus. -...

  • DevOps Engineer

    4 months ago

    Pune, India Corning Full time

    Requisition Number: 64335 Corning is vital to progress – in the industries we help shape and in the world we share. We invent life-changing technologies using materials science. Our scientific and manufacturing expertise, boundless curiosity, and commitment to purposeful invention place us at the center of the way the world interacts, works, learns, and...

  • System Admin

    5 months ago

    Pune, Maharashtra, India aioneers GmbH Full time

    **ABOUT US**: aioneers is a startup based out of Mannheim, Germany. At aioneers we focus on supply chain problems and build products critical in solving the gaps in supply-chains using cutting edge technology driven by ai. Backed by serial entrepreneurs and tycoons of industry, we have grown a solid, creative and highly capable team. **YOUR ROLE AT...

  • Senior Cloud Infrastructure Engineer

    4 weeks ago

    Pune, Maharashtra, India D-TechWorks Pvt Ltd Full time

    **D-TechWorks Pvt Ltd** is seeking an experienced **Senior Cloud Infrastructure Engineer** to design, develop, and maintain our robust infrastructure on Azure. **Key Responsibilities**: Create and implement effective DevOps strategies using Azure DevOps tools. Collaborate with development teams to establish efficient workflows and ensure code quality...

  • Azure DevOps Engineer

    4 weeks ago

    Pune, India D-TechWorks Pvt Ltd Full time

    Position : Azure DevOps EngineerLocation : Pune- Work from Office Experience : 5-8 YearsNotice Period : Immediate to 20DaysMandatory Skills : Azure Devops ,Jenkins, CI/CD, Terraform.We are seeking a seasoned Azure DevOps Engineer to join our dynamic team. In this role, you will play a pivotal role in designing, developing, and maintaining our robust...

  • Azure Data Factory

    7 days ago

    Bengaluru / Bangalore, Pune, India Anlage Infotech India Private Limited Full time

    Responsibilities - AZUREYou are an expert in Azure Data Analytics having thorough understanding of Azure Data Platform tools.Expertise and hands on experience in at least 4 tools on Azure Platform among: Data Factory, Data Bricks, Synapse, Data Lake Gen2, Stream Analytics, Azure Spark, Azure ML.Expertise in SQL Server DB, Cosmos DB.Collaborate with project...