Azure Data Engineer

2 weeks ago

Noida, India Dmi Innovations Full time

Minimum Requirements:

  • 5+ years of experience overall in IT
  • Current - 2+ years of experience on Azure Cloud as Data Engineer
  • Current years of hands-on experience on Databricks/ AzureDatabricks
  • Proficient in Python/PySpark
  • Proficient in SQL/TSQL
  • Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC)

Primary Skills:

Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python

Technical Expertise:

  • ETL/ELT Pipelines: Design, implementation, and optimization.
  • Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations.
  • Databricks: Hands-on experience with creating notebooks and performing data transformations.
  • Fimilarity with Dataflows, Data Wrangling, and integration with REST APIs.
  • Experience with Parquet and Delta file processing, along with optimization techniques
  • Fimilarity with Azure DevOps and CI/CD

Concepts and Methodologies:

  • Data Warehousing: Comprehensive understanding of concepts and implementation
  • Data Modelling Techniques: Familiarity with Data Vault (if not, then Dimensional Modelling Technique)
  • SCD and CDC: Strong grasp of Slowly Changing Dimensions (SCD) and Change Data Capture (CDC) methodologies
  • Agile Methodology

Programming Skills:

  • Python/PySpark/SparkSQL Strong proficiency in any of these
  • SQL/T-SQL

A must have:

  • Demonstrates strong association with team dynamics and the ability to maintain harmony in a collaborative environment.
  • Proven ability to be a team player who contributes to shared goals while supporting peers

Good to have:

  • Basic knowledge on Delta Tables, Delta Live Tables (DLT), Partitioning and Optimization.
  • Knowledge of Unity Catalog and Job Clusters is an added advantage.
  • Familiarity with tools like Azure Monitor, Log Analytics, and Spark UI is an added advantage.
  • Good to have knowledge with real-time data ingestion and streaming Piplelines.
  • Experience with framework driven projects (Metadata framework, Audit control framework)
  • Relational and No-SQL Databases

Certifications:

AZ 900 - Azure fundamentals

DP 203 - Azure Data Engineer

Databricks Associate Data Engineer

  • Azure data Engineer

    2 days ago

    Noida, Uttar Pradesh, India Flight Centre Travel Group Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. You will play a crucial role in developing, optimizing, and maintaining data pipelines and architectures, ensuring data...

  • Azure Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Dmi Innovations Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Minimum Requirements:5+ years of experience overall in ITCurrent - 2+ years of experience on Azure Cloud as Data EngineerCurrent years of hands-on experience on Databricks/ AzureDatabricksProficient in Python/PySparkProficient in SQL/TSQLProficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC)Primary...

  • Azure Data Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India Infogain Full time

    Posted on August 31 2024ROLES RESPONSIBILITIES Buildand Maintain pipelines to bring maintain in wide variety of data from multiple sources within the organization as well as from social media and public data sources xc2 xb7 Collaborate with cross functional teams to source data and make it available for downstream consumption xc2 xb7 Work with the...

  • Azure Architect

    1 week ago

    Noida, India Polestar Analytics Full time

    Azure Architect – Analytics & Data Services Location: Job Type: Full-time Experience: 8+ years Lead end-to-end architecture design for data and analytics solutions on Azure. Define and implement Azure-based modern data platforms, including data lakes and data warehouses. Partner with project managers to oversee solution delivery and ensure timelines...

  • Senior Azure Data Engineer

    6 days ago

    Noida, Uttar Pradesh, India Eice Technology Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Urgent Requirement Senior Azure Data Engineer - Microsoft Fabric SpecialistLocation: Noida (Onsite, Long-Term Project Full Time)Need Immediate Joiners OnlyAbout the RoleWe are looking for a highly experienced Azure Data Engineer with 10+ years of expertise in data engineering, Microsoft Fabric, and modern data platforms. The ideal candidate will have deep...

  • Azure Data Engineer + Palantir

    3 weeks ago

    Noida, Uttar Pradesh, India Epergne Solutions Full time

    Job DescriptionJob Role: -Azure Data Engineer + PalantirJob Location: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience :- 5+ YearsWe are seeking experienced Azure Data Engineers with hands-on expertise in Palantir Foundryto architect, build, and optimize large-scale data integration pipelines and analytical models for enterprise-scale deployments.Core...

  • Azure architect

    5 days ago

    Noida, India Polestar Analytics Full time

    Job Title: Azure Architect – Analytics & Data Services Location: Noida/Kolkata/Bengaluru Job Type: Full-time Experience: 8+ years Industry: Analytics Services Roles and Responsibilities Lead end-to-end architecture design for data and analytics solutions on Azure. Define and implement Azure-based modern data platforms, including data lakes and data...

  • Azure Architect

    7 days ago

    Noida, India Polestar Analytics Full time

    Job Title: Azure Architect – Analytics & Data ServicesLocation: Noida/Kolkata/BengaluruJob Type: Full-timeExperience: 8+ yearsIndustry: Analytics ServicesRoles and ResponsibilitiesLead end-to-end architecture design for data and analytics solutions on Azure.Define and implement Azure-based modern data platforms, including data lakes and data...

  • Azure Architect

    1 week ago

    Noida, India Polestar Analytics Full time

    Job Title: Azure Architect – Analytics & Data ServicesLocation: Noida/Kolkata/BengaluruJob Type: Full-timeExperience: 8+ yearsIndustry: Analytics ServicesRoles and ResponsibilitiesLead end-to-end architecture design for data and analytics solutions on Azure.Define and implement Azure-based modern data platforms, including data lakes and data...

  • Azure Architect

    7 days ago

    Noida, India Polestar Analytics Full time

    Job Title: Azure Architect – Analytics & Data ServicesLocation: Noida/Kolkata/BengaluruJob Type: Full-timeExperience: 8+ yearsIndustry: Analytics ServicesRoles and Responsibilities- Lead end-to-end architecture design for data and analytics solutions on Azure.- Define and implement Azure-based modern data platforms, including data lakes and data...