Azure Data Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations Live Connections Full time

Azure Data Engineer - Python/PySpark


We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.


Key Responsibilities :


- PySpark Development : Lead and contribute to the development of data engineering solutions using PySpark and Python within the Azure Databricks platform.


- Azure Databricks Expertise : Utilize deep knowledge and experience with Azure Databricks to design, implement, and optimize data workflows and pipelines.


- Coding Proficiency : Demonstrate a minimum of 3 years of hands-on experience in PySpark with Python coding, ensuring high-quality and efficient code development.


- Data Integration : Work collaboratively with cross-functional teams to integrate data from various sources, ensuring data accuracy, consistency, and reliability.


- Performance Optimization : Identify and implement performance optimization techniques to enhance the efficiency of data processing and analytics.


- Data Transformation : Develop and maintain data transformation processes to support the extraction, transformation, and loading (ETL) of data into data lakes or warehouses.


- Collaboration : Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and contribute to the design and implementation of scalable and reliable data :


1. Bachelor's degree in Computer Science, Information Technology, or a related field.


2. Minimum of 6 years of experience in data engineering, with a focus on PySpark and Python development.


3. Proven experience (at least 3 years) in PySpark with Python coding.


4. Solid understanding of Azure Databricks and its components.


5. Strong problem-solving and analytical skills.


6. Excellent communication and collaboration abilities.


7. Experience with data lakes, data warehouses, and ETL processes.


8. Familiarity with big data technologies and distributed computing.

(ref:hirist.tech)
  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Azure Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : Azure Databricks Azure ADF PySpark Python SQLResponsibilities : Collaborate on ETL data requirements. Design and optimize data pipelines (Azure Databricks, ADF). Develop PySpark scripts for efficient data processing. Ensure ETL tasks' performance and scalability (Python,...

  • Azure Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations TekNinjas Full time

    Role :Data Engineer - Azure Synapse Analytics- Experience in Data engineering projects using Microsoft Azure platform (Minimum of 23 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Azure Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Azure Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations/Bangalore Arting Digital Full time

    Position Title : Azure Data Engineer Exp : 5+ years Location : Remote Primary Skills :Azure Databricks, Azure ADF, Pyspark, Python & SQL Qualification : AnyRoles and responsibilities : An offshore Data Engineer to work with the Investment Analytics team. This person needs to have a strong exp of Azure Data bricks, Azure ADF, Pyspark Python & SQL A strong...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Azure Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is must Location : Pan IndiaFulltime role Immediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure...

  • Azure Data Engineer

    2 months ago


    Anywhere in India/Multiple Locations DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is must Location : Pan IndiaFulltime role Immediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Job Description : At Excelra ,We are seeking a highly skilled Data Engineer with expertise in Databricks, SQL, Python, and data flow pipelines. The ideal candidate will have experience in creating Azure Data Factory (ADF) pipelines, deploying code in Azure DevOps using Git Repos and YAML files, and exposure to Snowflake. This role involves designing,...

  • Azure Data Engineer

    4 weeks ago


    Anywhere in India/Multiple Locations, IN TekNinjas Full time

    Role : Data Engineer - Azure Synapse Analytics - Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT using...

  • Azure Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations TekNinjas Full time

    Role : Data Engineer - Azure Synapse Analytics - Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT using...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations UNICO CONNECT PRIVATE LIMITED Full time

    Role : Data Engineer - Azure Synapse Analytics- Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT using...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations TekNinjas Full time

    Role : Data Engineer - Azure Synapse Analytics - Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT using...