Lead azure data engineer
2 weeks ago
Experience: 8 -12 Years
Working Days: 5 Days
Location: Hyderabad
Notice Period: Immediate or 15 days maximum.
Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live Tables
Job Description:
As discussed, they must possess the following skills:
Experience in writing Python & pyspark code. Good to have experience in creating the pipeline to read the data from the Streaming sources.
Knowledge of Kimball SCD Type 1 and Type 2 and when to use it.
Expert in building data pipelines on azure data factory, Azure data bricks. Should have the ability to write complex SQL queries.
Good communication skills both written and verbal in English.
Knowledge on change data capture.
Should have knowledge in Medallion Architecture, Synapse
Experience into Streaming Data
Azure Data Factory –
Parametrization and reusable linked services, datasets, and pipelines
Self-hosted IRs
Databricks –
DELTA LIVE Tables with time travel experience
Structured LIVE streaming with DELTA LIVE Tables
Knowledge of Optimization and partition best practices.
Knowledge of how to use the Unity Catalog and its benefits.
Mounting Technique.
Streaming Data
KAFKA, KAFKA Connectors (Debezium MYSQL), Striim
Ideally knowledge of Confluent Kafka.
Event hubs, service bus, Azure Function.
About Veltris
• Where Innovation, Acceleration and Transformation meet to deliver high-ROI
technology and business solutions.
• Our design thinking approach to agile software development coupled with premium
full-stack capabilities, and a cutting-edge innovation mindset accelerates time-tomarket. This results in long-term strategic and competitive advantages for our clients
and partners.
• Veltris – Innovate, Accelerate, Transform to enable technology-driven Enterprise,
Business, and Industry transformations.
-
Azure Data Engineering Lead
4 weeks ago
Hyderabad, Telangana, India Vertex Offshore Services Pvt Ltd Full timeJob Title: Azure Data Engineering LeadWe are seeking a highly skilled and experienced Azure Data Engineering Lead to join our team at Vertex Offshore Services Pvt Ltd.Job Summary:Vertex Offshore Services Pvt Ltd is looking for a seasoned Azure Data Engineering Lead to design, build, and maintain scalable data solutions on the Azure platform. As an Azure Data...
-
Azure Data Engineering Lead
7 days ago
Hyderabad, Telangana, India Syren Cloud Inc Full timeJob SummaryWe are seeking a highly skilled Azure Data Engineer to lead our data engineering efforts. As an expert in designing and implementing distributed applications and systems on Azure Cloud platform, you will be responsible for developing, implementing, and managing large-scale data pipelines.
-
Lead Data Engineer- Azure
6 months ago
Hyderabad, India YASH Technologies Full timeWe are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What...
-
Lead Data Engineer- Azure
6 months ago
Hyderabad, India YASH Technologies Full timeWe are looking forward to hire “Lead Azure Data Engineers” who thrives on challenges and desire to make a real difference in the business world. With an environment of extraordinary innovation and unprecedented growth, this is an exciting opportunity for a self-starter who enjoys working in a fast-paced, quality-oriented, and team environment. What you...
-
Azure Data Engineer Lead
1 month ago
Hyderabad, Telangana, India Syren Cloud Inc Full timeJob Title: Lead Azure Data EngineerWe are seeking a highly skilled Lead Azure Data Engineer to join our team at Syren Cloud Inc. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing distributed applications and systems on the Azure Cloud platform.Key Responsibilities:Design and develop databases,...
-
Lead Azure Data Engineer
2 weeks ago
hyderabad, India Veltris Full timeDesignation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 Days Location: Hyderabad Notice Period: Immediate or 15 days maximum. Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live Tables Job Description: As discussed, they must possess the following skills: Experience in writing Python &...
-
Lead Azure Data Engineer
2 weeks ago
Hyderabad, India Veltris Full timeDesignation: Lead Azure Data EngineerExperience: 8 -12 YearsWorking Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills:Experience in writing Python & pyspark...
-
Lead Azure Data Engineer
2 weeks ago
Hyderabad, India Veltris Full timeDesignation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills: Experience in writing Python & pyspark...
-
Lead Azure Data Engineer
2 weeks ago
Hyderabad, India Veltris Full timeDesignation: Lead Azure Data Engineer Experience: 8 -12 Years Working Days: 5 DaysLocation: HyderabadNotice Period: Immediate or 15 days maximum.Mandatory Skills- Azure Data Factory (ADF), Python/ Pyspark, Streaming Data, Databricks, Delta Live TablesJob Description:As discussed, they must possess the following skills: Experience in writing Python & pyspark...
-
Digital Engineering Lead
3 weeks ago
Hyderabad, Telangana, India NTT DATA Full timeJob Title: Digital Engineering LeadJob Summary:We are seeking a highly skilled Digital Engineering Lead to join our team in Hyderabad, Telangana, India. The successful candidate will be responsible for designing, implementing, and maintaining Azure Synapse data pipelines and transformation for data ingestion, transformation, and loading.Key...
-
Azure Data Engineer
1 month ago
Hyderabad, Telangana, India Arting Digital Full timeJob Title: Azure Data EngineerExperience: 5+ yearsLocations: HyderabadPrimary Skills: Azure Cloud services, CI/CD pipelines, Data Model, Azure Data Factory, Azure Data bricks, Synapse, Power BIBudget: 25LPANotice Period: 15-30 daysAs a seasoned Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing...
-
Azure Data Engineer
6 months ago
Hyderabad, India ValueMomentum Full timeJob Summary: Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on! ValueMomentum is seeking an Azure Data Engineer to join our DataLeverage teams who will be responsible for leading technology innovation in the area of Azure...
-
Data Engineer
4 weeks ago
Hyderabad, India NTT DATA Full timeJob Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...
-
Azure data engineer
1 month ago
Hyderabad, India Clean Harbors Full timeJob Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...
-
Azure Data Engineer
1 month ago
Hyderabad, India Clean Harbors Full timeJob Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...
-
Azure Data Engineer
1 month ago
hyderabad, India Clean Harbors Full timeJob Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...
-
Azure Data Engineer
3 weeks ago
hyderabad, India Clean Harbors Full timeJob Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...
-
Azure Data Engineer
3 weeks ago
Hyderabad, India Clean Harbors Full timeJob Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...
-
Azure Data Engineer
2 weeks ago
Hyderabad, India Clean Harbors Full timeJob Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...
-
Azure Data Engineer
3 weeks ago
hyderabad, India Clean Harbors Full timeJob Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...