Azure Data Engineer

20 hours ago

Noida, Uttar Pradesh, India Dmi Innovations Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Minimum Requirements:

  • 5+ years of experience overall in IT
  • Current - 2+ years of experience on Azure Cloud as Data Engineer
  • Current years of hands-on experience on Databricks/ AzureDatabricks
  • Proficient in Python/PySpark
  • Proficient in SQL/TSQL
  • Proficient in Data Warehousing Concepts (ETL/ELT, Data Vault Modelling, Dimensional Modelling, SCD, CDC)

Primary Skills:

Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python

Technical Expertise:

  • ETL/ELT Pipelines: Design, implementation, and optimization.
  • Azure ADF and Synapse: Proficiency in creating pipelines, developing notebooks, and performing data transformations.
  • Databricks: Hands-on experience with creating notebooks and performing data transformations.
  • Fimilarity with Dataflows, Data Wrangling, and integration with REST APIs.
  • Experience with Parquet and Delta file processing, along with optimization techniques
  • Fimilarity with Azure DevOps and CI/CD

Concepts and Methodologies:

  • Data Warehousing: Comprehensive understanding of concepts and implementation
  • Data Modelling Techniques: Familiarity with Data Vault (if not, then Dimensional Modelling Technique)
  • SCD and CDC: Strong grasp of Slowly Changing Dimensions (SCD) and Change Data Capture (CDC) methodologies
  • Agile Methodology

Programming Skills:

  • Python/PySpark/SparkSQL Strong proficiency in any of these
  • SQL/T-SQL

A must have:

  • Demonstrates strong association with team dynamics and the ability to maintain harmony in a collaborative environment.
  • Proven ability to be a team player who contributes to shared goals while supporting peers

Good to have:

  • Basic knowledge on Delta Tables, Delta Live Tables (DLT), Partitioning and Optimization.
  • Knowledge of Unity Catalog and Job Clusters is an added advantage.
  • Familiarity with tools like Azure Monitor, Log Analytics, and Spark UI is an added advantage.
  • Good to have knowledge with real-time data ingestion and streaming Piplelines.
  • Experience with framework driven projects (Metadata framework, Audit control framework)
  • Relational and No-SQL Databases

Certifications:

AZ 900 - Azure fundamentals

DP 203 - Azure Data Engineer

Databricks Associate Data Engineer

  • Azure data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Flight Centre Travel Group Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a skilled Azure Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, working with Azure cloud services, and designing and implementing scalable data solutions. You will play a crucial role in developing, optimizing, and maintaining data pipelines and architectures, ensuring data...

  • Azure Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Infogain Full time

    Posted on August 31 2024ROLES RESPONSIBILITIES Buildand Maintain pipelines to bring maintain in wide variety of data from multiple sources within the organization as well as from social media and public data sources xc2 xb7 Collaborate with cross functional teams to source data and make it available for downstream consumption xc2 xb7 Work with the...

  • Azure Data Engineer + Palantir

    7 days ago

    Noida, Uttar Pradesh, India Epergne Solutions Full time

    Job DescriptionJob Role: -Azure Data Engineer + PalantirJob Location: Noida/Gurgaon/Hyderabad/Bangalore/PuneExperience :- 5+ YearsWe are seeking experienced Azure Data Engineers with hands-on expertise in Palantir Foundryto architect, build, and optimize large-scale data integration pipelines and analytical models for enterprise-scale deployments.Core...

  • Azure Data Engineer

    1 week ago

    Greater Noida, Uttar Pradesh, India ipeople Infosystems LLC Full time ₹ 25,00,000 - ₹ 26,00,000 per year

    Role: Azure Data EngineerLocation: Greater Noida (onsite) (24/7 available for support)Type: Full timeExperience -: 7+ yearsMust have skills:Azure Databricks, Azure data factory, SQLJob Description:ADF (Azure data factory)DatabricksSQL queries (MS SQL, MySQL, Cassandra etc.. any)Working Knowledge on any ETL tool (preferably on Talend) not mandatory but good...

  • Azure Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Bizbrolly Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Python, Azure app functions, Azure arch, Azure functions, Azure services7+ Years of Overall IT experience.3+ Years of experience - Azure Architecture / Engineering (one or more of: Azure Functions, App Services)3+ Years of experience - Development (Python, C#)1+ CI/CD Experience (GitHub preferred)

  • Azure Cloud Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeCloud Full time ₹ 35,00,000 - ₹ 40,00,000

    Our Company is a leading player in the field of Property & Casualty (P&C) Insurance and Property Restoration. We are seeking an experienced Senior DevOps Engineer with expertise in Azure Cloud and Data Engineering to join our global team.The successful candidate will work closely with data engineering and IT teams to build and optimize cloud infrastructure,...

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 303115NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties As a data engineer you will have a...

  • Azure Data Architect

    2 weeks ago

    Noida, Uttar Pradesh, India Optimus Information Inc. Full time

    Company DescriptionOptimus Information is a leading technology consulting company that provides professional and managed services in cloud migration and management, DevOps, application development and modernization, data analytics, and testing. With deep Azure expertise and a global delivery model, we help clients achieve their digital transformation goals....

  • Azure Data Engineer

    2 weeks ago

    Greater Noida, Uttar Pradesh, India Vision Excel Career Solutions Full time

    Job Title : Technical AnalystJob Description :- Strong technical experience in ETL/data warehousing projects using MS technology stack (preferably Azure, ADF) - Work with internal and external teams in migrating data from various on-premise source systems to various Azure data factory - Hands-on experience in building Azure pipelines, and framework...

  • Azure Data Architect

    2 weeks ago

    Noida, Uttar Pradesh, India Optimus Information Inc. Full time

    Company Description Optimus Information is a leading technology consulting company that provides professional and managed services in cloud migration and management, DevOps, application development and modernization, data analytics, and testing. With deep Azure expertise and a global delivery model, we help clients achieve their digital transformation...