Lead azure data engineer

2 months ago

Hyderabad, India Veltris Full time
Designation: Lead Azure Data Engineer
Experience: 8 -12 Years
Working Days: 5 Days
Location: Hyderabad
Notice Period: Immediate or 15 days maximum.
Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live Tables
Job Description:
As discussed, they must possess the following skills:
Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources.
Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.
Good communication skills both written and verbal in English.
Knowledge on change data capture.
Should have knowledge in Medallion Architecture, Synapse
Experience into Streaming Data
Azure Data Factory –
Parametrization and reusable linked services, datasets, and pipelines
Self-hosted IRs
Databricks –
DELTA LIVE Tables with time travel experience
Structured LIVE streaming with DELTA LIVE Tables
Knowledge of Optimization and partition best practices.
Knowledge of how to use the Unity Catalog and its benefits.
Mounting Technique.
Streaming Data
KAFKA, KAFKA Connectors (Debezium MYSQL), Striim
Ideally knowledge of Confluent Kafka.
Event hubs, service bus, Azure Function.
About Veltris
• Where Innovation, Acceleration and Transformation meet to deliver high-ROI
technology and business solutions.
• Our design thinking approach to agile software development coupled with premium
full-stack capabilities, and a cutting-edge innovation mindset accelerates time-tomarket. This results in long-term strategic and competitive advantages for our clients
and partners.
• Veltris – Innovate, Accelerate, Transform to enable technology-driven Enterprise,
Business, and Industry transformations.

  • Tech lead

    3 weeks ago

    Hyderabad, India Trinity Consulting Services Full time

    We are looking for an experienced Tech Lead - Azure Data Engineer with a strong background in Data Warehousing (DWH) and Azure technologies. The ideal candidate will have extensive experience in building and leading data solutions, particularly in Azure Data Bricks, Azure Data Factory, and the Big Data stack.Key Responsibilities:Lead a team of developers...

  • Senior Azure Data Engineer Lead

    4 weeks ago

    Hyderabad, Telangana, India iVEGA Consulting Full time

    Job DescriptionWe are seeking an experienced Senior Azure Data Engineer Lead to join our team at iVEGA Consulting.Key Responsibilities:Design, build, and maintain scalable data pipelines in the Azure environment to ensure smooth operation in both batch and real-time processing.Optimize Azure data infrastructure to facilitate accurate data extraction,...

  • Tech Lead

    3 weeks ago

    Hyderabad, India Trinity Consulting Services (“TRINITY”) Full time

    We are looking for an experienced Tech Lead - Azure Data Engineer with a strong background in Data Warehousing (DWH) and Azure technologies. The ideal candidate will have extensive experience in building and leading data solutions, particularly in Azure Data Bricks, Azure Data Factory, and the Big Data stack.Key Responsibilities:Lead a team of developers and...

  • Tech Lead

    3 weeks ago

    Hyderabad, India Trinity Consulting Services (“TRINITY”) Full time

    We are looking for an experienced Tech Lead - Azure Data Engineer with a strong background in Data Warehousing (DWH) and Azure technologies. The ideal candidate will have extensive experience in building and leading data solutions, particularly in Azure Data Bricks, Azure Data Factory, and the Big Data stack.Key Responsibilities:Lead a team of developers and...

  • Tech Lead

    3 weeks ago

    Hyderabad, India Trinity Consulting Services (“TRINITY”) Full time

    We are looking for an experienced Tech Lead - Azure Data Engineer with a strong background in Data Warehousing (DWH) and Azure technologies. The ideal candidate will have extensive experience in building and leading data solutions, particularly in Azure Data Bricks, Azure Data Factory, and the Big Data stack. Key Responsibilities: Lead a team of developers...

  • Azure data engineer

    1 day ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Azure Data Engineer

    4 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration) Position Overview: We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based...

  • Azure Data Engineer

    5 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Azure Data Engineer

    5 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Lead Azure Data Engineer

    2 months ago

    Hyderabad, India Veltris Full time

    Designation: Lead Azure Data EngineerExperience: 8 -12 YearsWorking Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills:Experience in writing Python & pyspark...

  • Lead Azure Data Engineer

    2 months ago

    Hyderabad, India Veltris Full time

    Designation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills: Experience in writing Python & pyspark...

  • Azure Engineering Lead

    3 weeks ago

    Hyderabad, Telangana, India Changeleaders Full time

    Job Description: We are seeking an experienced Senior Cloud Data Architect to lead our team in designing and implementing end-to-end data solutions using Azure Data services.Responsibilities:Lead the design and implementation of scalable and efficient data pipelines using Azure Data Factory, Azure Databricks, or Azure Synapse Analytics.Collaborate with...

  • Azure data engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 months ago

    hyderabad, India VidPro Consultancy Services Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-15 yearsLocation: Bangalore, Chennai, Delhi, Pune, Kolkata and GurgaonMandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactoryPrimary Roles and Responsibilities:● Developing Modern Data Warehouse solutions using Databricks and AWS/...

  • Azure Data Engineer

    3 months ago

    Hyderabad, India VidPro Consultancy Services Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-15 yearsLocation: Bangalore, Chennai, Delhi, Pune, Kolkata and GurgaonMandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactoryPrimary Roles and Responsibilities:●Developing Modern Data Warehouse solutions using Databricks and AWS/...