Lead azure data engineer

2 weeks ago


Hyderabad, India Veltris Full time
Designation: Lead Azure Data Engineer
Experience: 8 -12 Years
Working Days: 5 Days
Location: Hyderabad
Notice Period: Immediate or 15 days maximum.
Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live Tables
Job Description:
As discussed, they must possess the following skills:
Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources.
Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.
Good communication skills both written and verbal in English.
Knowledge on change data capture.
Should have knowledge in Medallion Architecture, Synapse
Experience into Streaming Data
Azure Data Factory –
Parametrization and reusable linked services, datasets, and pipelines
Self-hosted IRs
Databricks –
DELTA LIVE Tables with time travel experience
Structured LIVE streaming with DELTA LIVE Tables
Knowledge of Optimization and partition best practices.
Knowledge of how to use the Unity Catalog and its benefits.
Mounting Technique.
Streaming Data
KAFKA, KAFKA Connectors (Debezium MYSQL), Striim
Ideally knowledge of Confluent Kafka.
Event hubs, service bus, Azure Function.
About Veltris
• Where Innovation, Acceleration and Transformation meet to deliver high-ROI
technology and business solutions.
• Our design thinking approach to agile software development coupled with premium
full-stack capabilities, and a cutting-edge innovation mindset accelerates time-tomarket. This results in long-term strategic and competitive advantages for our clients
and partners.
• Veltris – Innovate, Accelerate, Transform to enable technology-driven Enterprise,
Business, and Industry transformations.

  • Hyderabad, Telangana, India Vertex Offshore Services Pvt Ltd Full time

    Job Title: Azure Data Engineering LeadWe are seeking a highly skilled and experienced Azure Data Engineering Lead to join our team at Vertex Offshore Services Pvt Ltd.Job Summary:Vertex Offshore Services Pvt Ltd is looking for a seasoned Azure Data Engineering Lead to design, build, and maintain scalable data solutions on the Azure platform. As an Azure Data...


  • Hyderabad, Telangana, India Syren Cloud Inc Full time

    Job SummaryWe are seeking a highly skilled Azure Data Engineer to lead our data engineering efforts. As an expert in designing and implementing distributed applications and systems on Azure Cloud platform, you will be responsible for developing, implementing, and managing large-scale data pipelines.


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...


  • Hyderabad, India YASH Technologies Full time

    We are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...


  • Hyderabad, Telangana, India Syren Cloud Inc Full time

    Job Title: Lead Azure Data EngineerWe are seeking a highly skilled Lead Azure Data Engineer to join our team at Syren Cloud Inc. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing distributed applications and systems on the Azure Cloud platform.Key Responsibilities:Design and develop databases,...


  • hyderabad, India Veltris Full time

    Designation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 Days Location: Hyderabad Notice Period: Immediate or 15 days maximum. Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live Tables Job Description: As discussed, they must possess the following skills: Experience in writing Python &...


  • Hyderabad, India Veltris Full time

    Designation: Lead Azure Data EngineerExperience: 8 -12 YearsWorking Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills:Experience in writing Python & pyspark...


  • Hyderabad, India Veltris Full time

    Designation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills: Experience in writing Python & pyspark...


  • Hyderabad, India Veltris Full time

    Designation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills: Experience in writing Python & pyspark...


  • Hyderabad, Telangana, India NTT DATA Full time

    Job Title: Digital Engineering LeadJob Summary:We are seeking a highly skilled Digital Engineering Lead to join our team in Hyderabad, Telangana, India. The successful candidate will be responsible for designing, implementing, and maintaining Azure Synapse data pipelines and transformation for data ingestion, transformation, and loading.Key...

  • Azure Data Engineer

    1 month ago


    Hyderabad, Telangana, India Arting Digital Full time

    Job Title: Azure Data EngineerExperience: 5+ yearsLocations: HyderabadPrimary Skills: Azure Cloud services, CI/CD pipelines, Data Model, Azure Data Factory, Azure Data bricks, Synapse, Power BIBudget: 25LPANotice Period: 15-30 daysAs a seasoned Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing...

  • Azure Data Engineer

    6 months ago


    Hyderabad, India ValueMomentum Full time

    Job Summary: Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on! ValueMomentum is seeking an Azure Data Engineer to join our DataLeverage teams who will be responsible for leading technology innovation in the area of Azure...

  • Data Engineer

    4 weeks ago


    Hyderabad, India NTT DATA Full time

    Job Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...

  • Azure data engineer

    1 month ago


    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    1 month ago


    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 month ago


    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago


    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago


    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 weeks ago


    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago


    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...