Azure Data Engineer

4 weeks ago


india ValueLabs Full time

Job Title: Azure Data Engineer

Experience: 5+ years


Must have Skills:

ADF, SQL Server, Databricks Notebooks, Data Pipelines, SPROCs (Stored Procedures), DataWarehouse, Databricks DataLake


Job Description:


The Data Engineer is responsible for designing, developing, and maintaining data pipelines, data warehouses, and data lakes for an organization. They work closely with data scientists, analysts, and other stakeholders to ensure that data is efficiently stored, processed, and accessible for analysis. The Data Engineer must have a strong understanding of various data technologies, including ADF (Azure Data Factory), SQL Server, Databricks Notebooks, and SPROCs (Stored Procedures).


Key Responsibilities:


1. Design and develop data pipelines to extract, transform, and load (ETL) data from various sources into data warehouses or data lakes.

2. Create and maintain data models, schemas, and data structures in SQL Server and Databricks Data Lake.

3. Develop and optimize SPROCs for efficient data retrieval and manipulation.

4. Collaborate with data scientists, analysts, and other team members to understand data requirements and ensure data quality.

5. Monitor and troubleshoot data pipeline issues, and implement improvements to enhance performance and reliability.

6. Develop and maintain data documentation, including data dictionaries, pipeline diagrams, and data quality reports.

7. Stay current with new technologies, tools, and best practices in the data engineering field.


Requirements:


1. Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.

2. Strong programming skills in languages such as Python, R, or Scala.

3. Experience with data engineering tools and platforms, including ADF, SQL Server, Databricks Notebooks, and data pipelines.

4. Familiarity with data warehousing concepts and technologies.

5. Strong understanding of data modeling, ETL processes, and data quality principles.

6. Excellent problem-solving, analytical, and communication skills.

7. Ability to work independently and collaboratively in a fast-paced environment.


  • Azure Data Engineer

    1 month ago


    India YALLO Retail Full time

    Role Type: ContractLocation: RemoteDuration: 6 monthsStart: ASAPAs an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the integrity...

  • Azure Data Engineer

    1 month ago


    india YALLO Retail Full time

    Role Type: Contract Location: Remote Duration: 6 months Start: ASAP As an Azure Data Engineer, you will play a crucial role in designing, developing, and maintaining data engineering solutions on the Azure cloud platform. You will collaborate with cross-functional teams to understand data requirements, architect scalable data pipelines, and ensure the...

  • MLOps Engineer

    2 weeks ago


    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Azure Data Engineer

    3 hours ago


    india EXL Full time

    Position - Senior Data Engineer Work Location – Pune/ Hyderabad / Gurgaon / Hybrid Experience - 5+ Years Must have Skills: Minimum 4Y+ on Azure cloud services. Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions. Strong understanding of metadata-driven approaches and data governance principles....

  • Azure Data Engineer

    3 weeks ago


    india Direct Client Full time

    Azure Data Engineer - Fivetran or Snowflake Specialist Bengaluru, Data & Analytics JOB DESCRIPTION 1. Design, develop, and deploy data pipelines and workflows using Fivetran or Snowflake on the Azure platform. 2. Collaborate with business stakeholders to gather data requirements and translate them into technical specifications and Configure and customize...

  • Azure Data Engineer

    2 weeks ago


    India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises. ROLES AND RESPONSIBILITIES: Designing, developing, and testing Azure-based applications and services that meet business and technical requirements. To work in capacity of Azure Databricks, ADF and .net developer. Should have...

  • Azure Data Engineer

    2 weeks ago


    India Amicus Technology Full time

    This position is responsible for designing, implementing, and managing Azure-based solutions for medium-sized global enterprises.ROLES AND RESPONSIBILITIES: Designing, developing, and testing Azure-based applications and services that meet business and technical requirements.To work in capacity of Azure Databricks, ADF and .net developer.Should have...


  • india IntraEdge Full time

    As Azure Lead Data Engineer, you will have to take over the key activities of designing, coding, and implementing data solutions in the platform. With a focus on leveraging DBT for data transformation and modelling, as well as expertise in MDM tools, you will play a pivotal role in architecting scalable and performant data pipelines and warehouses. You will...

  • Azure Data Engineer

    3 weeks ago


    india LTIMindtree Full time

    Position: Azure Data Engineer Location: Hyderabad / Chennai / Pune / Mumbai / Bangalore / Kolkata Experience: 8 - 16 Years only Must have minimum of 6 Years of Database Experience with Azure cloud experience Must have Data Mesh Data products implementation experience Must have Data Governance Solution Experience Metadata Management Data Quality Lineage...

  • Azure Data Engineer

    6 days ago


    india Quadrant Technologies Full time

    Title: Azure Data Engineer Educational Qualification: BE/B.Tech/MS/MCA/M.ech or equivalent Experience : 3.5- 7 years Excellent communication and problem-solving skills Strong analytical skills in understanding business requirements Job Description for an Immediate Requirement: This is a full-time role for a Data Engineer located in Hyderabad with Quadrant...

  • Azure Data Engineer

    1 week ago


    india VDart Software Services Pvt. Ltd. Full time

    Job Title : Data Engineer Location: Remote Shift: (UK Shift) Responsible to create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery,...


  • india EXL Full time

    Position - Lead Data Engineer Work Location – Pune/ Hyderabad / Gurgaon / Hybrid Experience - 9+ Years Must have Skills: Minimum 5+ years on Azure cloud services. Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions. Strong understanding of metadata-driven approaches and data governance principles....

  • Azure Data Engineer

    3 days ago


    india Persistent Systems Full time

    About Position We are looking for a dynamic Azure Data Engineer with exposure and hands on exp on Azure Stack – Azure Data Factory, Databricks, Pyspark, Scala. Certified Databricks will be an added advantage. Exp in healthcare & clinical domain is preferred and good to have. Role : Azure Data Engineer Location: All PSL Locations Experience : 3 – 10...


  • india Consultz Full time

    Job Description This role is for DataHonDo, based in Singapore. Consultz is supporting the hiring for DataHonDo.Azure Data Platform Design and Implementation: Collaborate with cross-functional teams to understand data requirements and design scalable Azure data solutions. Implement and optimize data storage, processing, and analytics solutions on Azure,...

  • Azure Data Engineer

    1 week ago


    india Techolution Full time

    We are looking for a Azure Data Engineer with a driving passion to ensure that our customers have the most pleasant experience using our platform.This position will directly contribute to the WoW customer experience by consistently delivering the best quality of work. Our ideal candidate enjoys a work environment that requires strong problem solving skills...

  • MLOps Developer

    2 weeks ago


    india GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description : - Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring. - Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and...


  • india UBS Full time

    Your role You will be a member of the Artificial Intelligence, Data, and Analytics (ADA) Crew. Together with your colleagues you will contribute to building and maintaining a robust and secure self-service HR data analytics and data science platform. You will contribute to our most ambitious and critical technology projects as we migrate our applications...

  • Data Engineer

    2 months ago


    India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks) Location: Bangalore / HybridJob Type: Full-timeJob Description:Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...

  • Data Engineer

    2 months ago


    India VSquare Systems Pvt. Ltd. Full time

    Job Title: Data Engineer (Azure Databricks) Location: Bangalore / Hybrid Job Type: Full-time Job Description: Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations, and solution design, aiming to drive...


  • india YASH Technologies Full time

    Sr. Software Engineer - Azure Experience: 4 - 7 years of Experience What you should have? Azure Data Factory, Azure DevOps CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, PySpark, GitHub. Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL. Well versed with Azure Services Must have experience and knowledge on...