
Azure Data Factory Sr. Engineer
1 day ago
Experience Level:
Consultant: 5+ Years Relevant Experience
Associate Manager: 6+ Years Relevant Experience
Manager: 7+ Years Relevant Experience
Notice Period: Immediate to 30 Days (Preferred)
Job Summary:
We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft Azure.
Key Responsibilities:
Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks.
Implement and optimize data transformation using PySpark within Azure Databricks.
Build and manage data integration and orchestration workflows across diverse sources.
Work with Azure Synapse Analytics for data warehousing and analytics solutions.
Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL).
Collaborate with DevOps teams to automate deployment using CI/CD pipelines.
(Good to Have) Integrate real-time streaming data using Event Hub or similar technologies.
Follow best practices for data governance, security, and compliance.
Collaborate with stakeholders to gather requirements and deliver insights.
Required Skills:
Strong hands-on experience with:
Azure Data Factory (ADF)
Azure Databricks
PySpark
SQL
Azure Synapse Analytics
CI/CD and DevOps pipelines
Good to Have:
Experience with Event Hub or other real-time data streaming platforms.
Certifications (Preferred):
Microsoft Certified: Azure Data Engineer Associate (DP-203)
Databricks Certified Associate Developer
Preferred Attributes:
Strong problem-solving and analytical skills.
Excellent communication and collaboration abilities.
Ability to work independently and manage time effectively in a remote/hybrid setup.
Experience working in Agile/Scrum environments.
-
Sr azure data engineer
1 week ago
Bengaluru, Karnataka, India Optiremote Americas LLC Full time ₹ 1,99,000 - ₹ 2,99,999 per yearWe're Hiring: Data Engineer (Azure & SQL Expertise)Are you passionate about data integration, performance tuning, and cloud technologies? Join us and make an impact by building scalable, high-performance ETL pipelines on Azure.Optiremote Americas LLC is excited to announce an opening for a Sr Data Engineer (Azure & SQL Expertise) to join our growing teamWhat...
-
Azure Data Factory Engineer
1 week ago
Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAzure Data FactoryDescription :We are seeking an experienced Azure Data Factory professional to join our team in India. The ideal candidate will have extensive experience in designing and implementing data pipelines, ensuring high-quality data management, and optimizing data processing workflows. Responsibilities :Design and implement data pipelines using...
-
Senior Azure Data Factory
6 days ago
Bengaluru, Karnataka, India SIAGE Solutions Private Limited Full time ₹ 1,50,000 - ₹ 28,00,000 per yearJob Summary:We are seeking a skilledADF Developerwith 5 to 8 years of experience in designing, developing, and maintaining data integration solutions usingAzure Data Factoryand other Azure data services. The ideal candidate should have a strong background in data engineering, ETL/ELT processes, cloud data platforms, and SQL.Experience:5–8...
-
Azure Data Factory
1 week ago
Bengaluru, Karnataka, India People Prime Worldwide Full timeAbout Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and...
-
Azure Data Factory Engineer
1 week ago
Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per yearKey Responsibilities:Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks.Implement and optimize data transformation using PySpark within Azure Databricks.Build and manage data integration and orchestration workflows across diverse sources.Work with Azure Synapse Analytics for data warehousing and analytics solutions.Write...
-
Azure Data Factory-hyderabad
4 days ago
Bengaluru, Karnataka, India Diverse Lynx Full timeAzure Data Factory-Hyderabad Data Orchestration Create and schedule complex data processing tasks ensuring efficient and automated data movement and transformation Data Integration Transformation Connect to various data sources on-premises cloud files and perform transformations to prepare data for analytical purposes Develop ETL ELT...
-
Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per yearPlease find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...
-
Azure Data Factory Specialist
4 days ago
Bengaluru, Karnataka, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000In this role, you will be responsible for designing and implementing efficient data integration workflows using Azure Data Factory. The ideal candidate will have experience in developing ETL ELT pipelines to connect various data sources and perform transformations to prepare data for analytical purposes.Data OrchestrationYou will design, build, and implement...
-
Azure Data Engineer
1 week ago
Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full timeReporting Engineer (Azure Data Engineer)Experience Required : 5+ yearsLocation : BangaloreJob Description :We are looking for a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a robust background in developing and maintaining data solutions in Azure Cloud, with expertise in Azure Data Factory (ADF), SSIS,...
-
Azure Data Factory Developer
1 week ago
Bengaluru, Karnataka, India Acesoft Labs Full time US$ 90,000 - US$ 1,20,000 per yearRole & responsibilitiesDesign, develop, and maintain data pipelines using Azure Data FactoryCreate and manage data models in PostgreSQL, ensuring efficient data storage and retrieval.Optimize query performance and database performance in PostgreSQL, including indexing, query tuning, and performance monitoring.Strong knowledge on data modeling and mapping...