Senior Azure Data Engineer

2 weeks ago

Anywhere in IndiaMultiple Locations Softtech Career Infosystem Pvt. Ltd. Full time

Job Description :

  • Design and implement Azure cloudbased Data Warehousing and Governance architecture with Lakehouse paradigm
  • Integrating technical functionality, ensuring data accessibility, accuracy, and security.
  • Architect the Unity Catalog to provide centralized access control, auditing, lineage, and data discovery capabilities across Databricks workspaces.
  • Define and organize data assets (structured and unstructured) within the Unity Catalog.
  • Enable data analysts and etl engineers to discover and classify data, notebooks, dashboards, and files across clouds and platforms.
Implement a single permission model for data and AI assets.

  • Define access policies at a granular level (rows, columns, features) to ensure secure and consistent access management across workspaces and platforms.
  • Leverage Delta Sharing to enable easy data sharing across regions, and platforms.
  • Ensure that data and AI assets can be securely shared with minimal replication, maintaining a unified experience for users.
  • Monitoring and Observability: utilize AI to automate monitoring, diagnose errors, and maintain data and quality.
  • Set up alerts for personally identifiable information (PII) detection, and operational intelligence.
  • Work closely with data scientists, analysts, and engineers to promote adoption of the Unity Catalog.
  • Provide training and documentation to ensure effective usage and compliance with governance policies.

Skills :

  • Designed data warehouse and data lake solutions along with data processing Pipeline using PySpark using Databricks
  • Performed Data Modelling on Databricks [Delta Table] for transactional and analytical need.
  • Designed and developed pipelines to load data to Data Lake
  • Databricks Platform Proficiency, including its components like Databricks SQL, Delta Live Tables, Databricks Repos, and Task Orchestration.
  • Deep understanding of data governance principles, especially related to data cataloging, access control, lineage, and metadata management.
  • Strong SQL skills for querying and managing data
  • Ability to design and optimize data models for structured and unstructured data.
  • Understand how to manage compute resources, including clusters and workspaces.
  • Ability to adapt to changes and emerging trends in data engineering and governance.
  • Involved in hands on development and configuration of Unity Catalog
)

  • Senior Data Engineer

    1 month ago

    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Senior Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • MLOps Engineer

    2 months ago

    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago

    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : Azure Databricks Azure ADF PySpark Python SQLResponsibilities : Collaborate on ETL data requirements. Design and optimize data pipelines (Azure Databricks, ADF). Develop PySpark scripts for efficient data processing. Ensure ETL tasks' performance and scalability (Python,...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations TekNinjas Full time

    Role :Data Engineer - Azure Synapse Analytics- Experience in Data engineering projects using Microsoft Azure platform (Minimum of 23 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT...

  • Azure Data Engineer

    4 weeks ago

    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    1 month ago

    Metros/Anywhere in India/Multiple Locations Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    4 weeks ago

    Metros/Anywhere in India/Multiple Locations Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    4 weeks ago

    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    2 months ago

    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations/Bangalore Arting Digital Full time

    Position Title : Azure Data Engineer Exp : 5+ years Location : Remote Primary Skills :Azure Databricks, Azure ADF, Pyspark, Python & SQL Qualification : AnyRoles and responsibilities : An offshore Data Engineer to work with the Investment Analytics team. This person needs to have a strong exp of Azure Data bricks, Azure ADF, Pyspark Python & SQL A strong...

  • Senior Azure Cloud Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations ASPIRE NXT PRIVATE LIMITED Full time

    Experience : 5 - 8 yrs Employment Type : Permanent with AspireNxtJob Title : Senior Azure Cloud Engineer The Cloud Engineer under moderate supervision is responsible for designing, developing, implementing, and supporting the recommended infrastructure. This involves analysing, configuring, testing, and implementing the infrastructure. This may also...

  • Senior Azure Cloud Engineer

    3 months ago

    Anywhere in India,Multiple Locations ASPIRE NXT PRIVATE LIMITED Full time

    Experience : 5 - 8 yrs Employment Type : Permanent with AspireNxtJob Title : Senior Azure Cloud Engineer The Cloud Engineer under moderate supervision is responsible for designing, developing, implementing, and supporting the recommended infrastructure. This involves analysing, configuring, testing, and implementing the infrastructure. This may also...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...