Azure Data Factory Sr. Engineer

1 day ago


Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 1,50,000 - ₹ 28,00,000 per year

Experience Level:

Consultant: 5+ Years Relevant Experience

Associate Manager: 6+ Years Relevant Experience

Manager: 7+ Years Relevant Experience

Notice Period: Immediate to 30 Days (Preferred)

Job Summary:

We are seeking a skilled Azure Data Engineer to join our growing data team. The ideal candidate will have hands-on experience with Azure Data Factory, Databricks, PySpark, and SQL, and will contribute to designing and implementing scalable, secure, and high-performance data solutions on Microsoft Azure.

Key Responsibilities:

Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks.

Implement and optimize data transformation using PySpark within Azure Databricks.

Build and manage data integration and orchestration workflows across diverse sources.

Work with Azure Synapse Analytics for data warehousing and analytics solutions.

Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL).

Collaborate with DevOps teams to automate deployment using CI/CD pipelines.

(Good to Have) Integrate real-time streaming data using Event Hub or similar technologies.

Follow best practices for data governance, security, and compliance.

Collaborate with stakeholders to gather requirements and deliver insights.

Required Skills:

Strong hands-on experience with:

Azure Data Factory (ADF)

Azure Databricks

PySpark

SQL

Azure Synapse Analytics

CI/CD and DevOps pipelines

Good to Have:

Experience with Event Hub or other real-time data streaming platforms.

Certifications (Preferred):

Microsoft Certified: Azure Data Engineer Associate (DP-203)

Databricks Certified Associate Developer

Preferred Attributes:

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Ability to work independently and manage time effectively in a remote/hybrid setup.

Experience working in Agile/Scrum environments.



  • Bengaluru, Karnataka, India Optiremote Americas LLC Full time ₹ 1,99,000 - ₹ 2,99,999 per year

    We're Hiring: Data Engineer (Azure & SQL Expertise)Are you passionate about data integration, performance tuning, and cloud technologies? Join us and make an impact by building scalable, high-performance ETL pipelines on Azure.Optiremote Americas LLC is excited to announce an opening for a Sr Data Engineer (Azure & SQL Expertise) to join our growing teamWhat...


  • Bengaluru, Karnataka, India Growel Softech Pvt. Ltd. Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Azure Data FactoryDescription :We are seeking an experienced Azure Data Factory professional to join our team in India. The ideal candidate will have extensive experience in designing and implementing data pipelines, ensuring high-quality data management, and optimizing data processing workflows. Responsibilities :Design and implement data pipelines using...


  • Bengaluru, Karnataka, India SIAGE Solutions Private Limited Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Job Summary:We are seeking a skilledADF Developerwith 5 to 8 years of experience in designing, developing, and maintaining data integration solutions usingAzure Data Factoryand other Azure data services. The ideal candidate should have a strong background in data engineering, ETL/ELT processes, cloud data platforms, and SQL.Experience:5–8...

  • Azure Data Factory

    1 week ago


    Bengaluru, Karnataka, India People Prime Worldwide Full time

    About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and...


  • Bengaluru, Karnataka, India AVE-Promagne Business Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Key Responsibilities:Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks.Implement and optimize data transformation using PySpark within Azure Databricks.Build and manage data integration and orchestration workflows across diverse sources.Work with Azure Synapse Analytics for data warehousing and analytics solutions.Write...


  • Bengaluru, Karnataka, India Diverse Lynx Full time

    Azure Data Factory-Hyderabad Data Orchestration Create and schedule complex data processing tasks ensuring efficient and automated data movement and transformation Data Integration Transformation Connect to various data sources on-premises cloud files and perform transformations to prepare data for analytical purposes Develop ETL ELT...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...


  • Bengaluru, Karnataka, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 25,00,000

    In this role, you will be responsible for designing and implementing efficient data integration workflows using Azure Data Factory. The ideal candidate will have experience in developing ETL ELT pipelines to connect various data sources and perform transformations to prepare data for analytical purposes.Data OrchestrationYou will design, build, and implement...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Coders Brain Technology Private Limited Full time

    Reporting Engineer (Azure Data Engineer)Experience Required : 5+ yearsLocation : BangaloreJob Description :We are looking for a highly skilled and experienced Azure Data Engineer to join our team. The ideal candidate will have a robust background in developing and maintaining data solutions in Azure Cloud, with expertise in Azure Data Factory (ADF), SSIS,...


  • Bengaluru, Karnataka, India Acesoft Labs Full time US$ 90,000 - US$ 1,20,000 per year

    Role & responsibilitiesDesign, develop, and maintain data pipelines using Azure Data FactoryCreate and manage data models in PostgreSQL, ensuring efficient data storage and retrieval.Optimize query performance and database performance in PostgreSQL, including indexing, query tuning, and performance monitoring.Strong knowledge on data modeling and mapping...