Azure Platform Engineer

3 weeks ago

india Peepal consulting Full time

Description :

Platform Design :

- Define best practices for end-to-end databricks platform.


- Work with databricks and internal teams on evaluation of new features of databricks (private preview/ public preview)

- Ongoing discussions with databricks product teams on product features

Platform Infra :

- Create new databricks workspaces (premium, standard, serverless) and clusters including right sizing

- Drop unused workspaces

- Delta Sharing : Work with enterprise teams on connected data (data sharing)

User Management :

- Create new security groups and add/delete users

- Assign Unity Catalog permissions to respective groups/teams

- Manage Quantum Collaboration platform sandbox for enterprise teams for ideation and innovation.

Troubleshooting Issues in Databricks :

- Investigate and diagnose performance issues or errors within Databricks.

- Review and analyze Databricks logs and error messages.

- Identify and address problems related to cluster configuration or job failures.

- Optimize Databricks notebooks and jobs for performance.

- Coordinate with Databricks support for unresolved or complex issues.

- Document common troubleshooting steps and solutions.

- Develop and test Databricks clusters to ensure stability and scalability.

Governance :

- Create dashboards to monitor job performance, cluster utilization, and cost.

- Design dashboards to cater to various user roles (e.g., data scientists, admins).

- Use Databricks APIs or integration with monitoring tools for up-to-date metrics.

- Establish alerts for performance degradation or unexpected resource usage.

- Ensure dashboards are user-friendly and provide actionable insights.

- Regularly review and update dashboards based on user feedback and changing requirements.

Security :

- Fix Issues Reported by Databricks Security Compliance Report

- Analyze security findings from Databricks compliance reports.

- Apply necessary configurations or updates to address security concerns.

- Track and verify the effectiveness of applied security measures.

- Work with cyber on any security changes that needs to be implemented.


(ref:hirist.tech)

  • Azure Platform Engineer

    3 days ago

    India beBee Careers Full time

    Azure Data Engineering Lead is a pivotal role in designing, developing, and managing data engineering solutions on the Microsoft Azure platform. The successful candidate will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the organization.Key Responsibilities:

  • Azure Data Platform Engineer

    3 days ago

    India beBee Careers Full time

    **Job Title:** Azure Data ArchitectAbout the RoleWe are seeking a highly experienced and skilled Azure Data Architect to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data platforms on Azure.The ideal candidate will have hands-on experience in Azure Databricks, Azure Data Factory,...

  • Data Engineering Lead

    3 days ago

    India beBee Careers Full time

    About this Role :This role involves leading data engineering efforts, designing, implementing, and optimizing data pipelines, and contributing to end-to-end data workflows.The ideal candidate will have a strong background in data engineering and experience working with various Azure services such as Azure Data Lake Storage (ADLS), Azure Data Factory (ADF),...

  • Azure Data Platform Specialist

    6 days ago

    India beBee Careers Full time

    Azure Data Engineers play a crucial role in ensuring data governance and security practices are implemented.Data Engineering Role:Design, implement, and manage data solutions on the Azure platformCollaborate with stakeholders to understand requirements and deliver solutionsMonitor and troubleshoot performance issuesMaintain up-to-date documentation for data...

  • Senior Data Engineer

    3 weeks ago

    India Resourcetree Global Services Full time

    ResourceTree Global Services is hiring Senior Data Engineer - Azure for its prestigious Analytics Client Role : Senior Data Engineer Location : Hyderabad/Pune/Delhi NCR Experience : 7 to 12 years Mandatory Skills : Azure Data Factory, Synapse Analytics, Databricks, ADLS, SQL, PySpark, and Python Objective : A "Senior Data Engineer" is mid-level professional...

  • Senior DevOps Engineer

    3 weeks ago

    India Peoplepro Staffing Agency Full time

    What You Will Do : We are looking for bright and experienced Senior DevOps Engineers who are both strong individual contributors and dynamic team leaders to join our dedicated DevOps Practice Group. As a Senior DevOps Engineer at Zemoso, you will leverage your expertise to provide DevSecOps services to our customers and internal development teams. Basic...

  • Senior DevOps Engineer

    3 weeks ago

    India IT Full time

    Mandatory Criteria (Can't be neglected during screening) : - Looking for Immediate joiners or max. 10 days of Notice Period candidates. - Bachelor's degree in computer science, engineering, or equivalent experience. What You Will Do : We are looking for bright and experienced Senior DevOps Engineers who are both strong individual contributors and dynamic...

  • AI Developer

    3 weeks ago

    India Technofocus Full time

    Azure Data Platform & AI Description : We are looking for Azure Data Platform & AI experts passionate about developing world-class training content, lab exercises, and learning experiences that help professionals master data engineering and AI on Microsoft Azure. In this role, you will design hands-on training modules, test lab manuals, and proof-of-concept...

  • Azure Data Platform

    3 days ago

    India beBee Careers Full time

    Azure Data Platform & AI ExpertWe are seeking a seasoned expert in Azure Data Platform and AI to design and develop world-class training content, lab exercises, and learning experiences that empower professionals to master data engineering and AI on Microsoft Azure.In this role, you will be responsible for creating hands-on training modules, test lab...

  • Azure Data Platform Architect

    3 days ago

    India beBee Careers Full time

    **About the Role:** As a data engineer, you will play a crucial role in designing and implementing scalable and reliable data platforms using Azure technologies.The ideal candidate will have a strong background in coding, data ingestion, and data processing, as well as experience with big data technologies.Responsibilities:Develop and maintain data storage...