Senior Azure Data Engineer
16 hours ago
Description :
This role requires 8 years of hands-on expertise in designing, building, and optimizing scalable, cloud-native data platforms within Microsoft Azure.
The successful candidate will be the technical lead for developing robust ELT/ETL pipelines, leveraging Azure Data Factory (ADF), Azure Databricks (PySpark), and ADLS Gen2 to support critical business reporting and analytics.
Role Requirements & Logistics :
Experience Required : 8 years
Location : Remote (India)
Job Type : Contract
Key Responsibilities & Technical Deliverables :
Data Platform Design & Pipeline Engineering :
- Pipeline Development : Design, develop, and maintain high-volume, resilient ELT/ETL data pipelines using native Azure services, primarily Azure Data Factory (ADF) and/or Azure Synapse Pipelines.
- Big Data Processing : Lead big-data processing initiatives, implementing a schema-on-read approach utilizing ADLS Gen2 (Azure Data Lake Storage Gen2) and Azure Databricks with PySpark for scalable data transformations.
- Data Modeling : Apply deep knowledge of data modelling techniques to ensure data structures are optimized for performance, cost efficiency, and consumption.
Performance, Optimization & Orchestration :
- Optimization : Optimize performance, cost, and reliability across complex data models, data lake storage patterns, and processing workflows to meet service level objectives (SLOs).
- Orchestration : Implement and manage robust data orchestration patterns to schedule, monitor, and manage pipeline dependencies.
- Reporting Enablement : Partner closely with analytics teams and business intelligence users to enable reporting and provide optimized data sources for tools like Power BI or Tableau.
Engineering Excellence & Cloud Integration :
- CI/CD Integration (Preferred) : Experience implementing CI/CD practices for data pipelines, integrating development and deployment processes within Azure DevOps or similar toolchains.
- Advanced SQL : Utilize Advanced SQL capabilities for complex data manipulation, stored procedures, and query tuning within Azure Synapse or related databases.
Required Skills & Expertise :
- Experience : 8 years of professional experience in data engineering/cloud development.
- Core Languages : Advanced SQL and Python (specifically PySpark required for Databricks).
- Azure ETL/Orchestration (Mandatory) : Expertise in Azure Data Factory (ADF) and data orchestration patterns.
- Azure Big Data (Mandatory) : Mandatory, hands-on experience with Azure Databricks (PySpark) and ADLS Gen2.
- Data Structure : Strong knowledge of data modelling principles and data warehousing concepts.
Preferred / Nice to Have :
- Prior experience with Azure Synapse Analytics is a significant advantage.
- Experience with front-end reporting languages like DAX/Power BI.
- Experience implementing CI/CD for data pipelines
-
Azure Data Engineer
7 days ago
Multiple Locations, India AVENSYS CONSULTING PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription : Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service a client...
-
Azure Data Engineer
6 days ago
Multiple Locations, India CROSSDEV TECHNOLOGIES PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 25,00,000 per yearDescription :Job Summary : We are looking for an experienced Data Engineer with around 3 years of hands-on experience, strong expertise in Azure Databricks and Azure Database services. The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring data quality, and supporting analytical and operational use cases....
-
Senior Data Engineer
1 week ago
Multiple Locations, India Digihelic Solutions Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : We are seeking a highly experienced and technically adept Senior Data Engineer to join our TAVS team in Pune. The ideal candidate will have a minimum of 12 years of relevant experience and a strong background in designing, developing, and optimizing large-scale data pipelines and data warehouse solutions. This role requires deep expertise...
-
Senior Data Engineer
12 hours ago
Multiple Locations, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 20,00,000 - ₹ 25,00,000 per yearTitle : Senior Data Engineer - SQL & Microsoft ETL StackLocation : 100% Remote (Must be in India)Duration of Project : 8 months contractAbout the Role : We are hiring a technically proficient Data Engineer for an 8-month, 100% remote contract role (must be based in India). This position requires advanced expertise in SQL and deep operational knowledge of...
-
Natobotics - Senior Data Engineer - Azure Databricks
24 hours ago
Anywhere in India/Multiple Locations Natobotics Technologies Pvt Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per yearDescription : Senior Data Engineer - Azure ETL/ELT & PySpark Location : Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Experience : 6-8 Years About the Role : We are seeking an experienced Senior Data Engineer with 6-8 years in data engineering to join our team across multiple locations. This role is focused on...
-
Senior Azure Data Engineer
3 days ago
Anywhere in India/Multiple Locations Delphi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription: Ready to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values. At Delphi Consulting Pvt. Ltd., we foster a thriving environment with a hybrid work model that lets you prioritize what matters most. Interviews and onboarding are conducted...
-
Azure Data Engineer
1 week ago
Anywhere in India/Multiple Locations AATRAL HR CONSULTING LLP Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription : We are looking for a skilled Azure Data Engineer to design, build, and maintain scalable data pipelines and architectures in Microsoft Azure. You will play a crucial role in enabling data-driven decision-making by transforming raw data into accessible, clean, and reliable datasets. If you have hands-on experience with Azure data...
-
Junior Data Engineer
6 days ago
Multiple Locations, India Sky Systems, Inc. Full time ₹ 40,00,000 - ₹ 1,20,00,000 per yearRole : Junior Data Engineer. Position Type : Full-Time Contract (40hrs/week). Contract Duration : Long Term. Work Schedule : 8 hours/day (Mon-Fri). Work Hours : 9:30 AM 6:30 PM IST. Location : 100% Remote. We are looking for a Junior Data Engineer who is passionate about building robust, scalable, and efficient data pipelines on...
-
Azure Data Engineer/Data Engineer
6 days ago
Anywhere in India/Multiple Locations TESTQ Technologies Limited Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAbout the Opportunity : We are looking for a skilled Azure Data Engineer / Data Engineer with hands-on experience in Azure Data Factory, Snowflake, Databricks, and DBT to architect and implement large-scale data integration and transformation pipelines. The ideal candidate will bring deep technical expertise in ETL/ELT design, data modeling, and big...
-
Azure Data Engineer
6 days ago
Anywhere in India/Multiple Locations Digivance Solution Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDescription :Position : Azure Data EngineerLocation : India (Remote / Hybrid)Experience : 7 Years (5-7 years relevant)Mode of Interview : Video InterviewBackground Verification : After onboardingRoles & Responsibilities : - Work in an Agile development environment to design, build, and optimize data solutions. - Develop and manage scalable ETL pipelines...
