Azure Data Factory

2 weeks ago

Mumbai, India ERGO Technology & Services Full time

Role & responsibilities

The Azure Data Factory Engineer is responsible for designing, implementing, and maintaining scalable data integration solutions using Azure Data Factory (ADF). This includes setting up and configuring Azure infrastructure components, integrating diverse data sources including REST APIs, and implementing CI/CD pipelines to support robust, secure, and automated data workflows.

Preferred candidate profile

  • Design and develop ETL/ELT pipelines using Azure Data Factory.
  • Set up and configure Azure infrastructure including resource groups, storage accounts, integration runtimes, and networking components.
  • Integrate data from various sources including REST APIs, databases, and cloud storage, ensuring secure authentication (e.g., OAuth2, Managed Identity, API keys).
  • Implement CI/CD pipelines for ADF using tools like Azure DevOps, Git, and infrastructure-as-code (ARM templates, Terraform).
  • Collaborate with data architects and business stakeholders to understand data requirements.
  • Monitor and optimize pipeline performance and troubleshoot issues.
  • Apply security best practices for data access and infrastructure.
  • Maintain documentation and ensure compliance with data governance policies.

Technical:

  • +5 years experience Azure Data Factory and Azure services
  • Strong experience with Azure Data Factory and Azure services (e.g., Azure Storage, Azure SQL, Key Vault).
  • Proficiency in data integration, transformation, and orchestration.
  • Experience with CI/CD tools and practices for ADF deployments.
  • Familiarity with infrastructure-as-code tools (ARM, Terraform).
  • Knowledge of REST API integration and authentication methods (OAuth2, API keys, Managed Identity).
  • Understanding of networking, identity management, and security in Azure.
  • Experience with DevOps practices and automation.

Behavioral Skills:

  • Excellent interpersonal and communication skills for working in a global environment
  • Experience working with technical support team(s).
  • Being customer oriented.
  • Very good English (speaking/writing) skills.
  • Willingness to learn and quickly adapt to changing requirements
  • Proactive approach to identifying issues and presenting solutions and options
  • Prioritize business impact and urgency
  • Ability to learn new technology and methodology quickly.

Soft Skills:

  • Very good knowledge to handle Application Support and Maintenance projects with different skill sets.
  • Good analytic skills and problem solving skills in short span of time.
  • Very good communication and presentation skills.
  • Ability to work in a team
  • conflict skills
  • flexibility
  • initiative
  • resilience

Previous Experience & Qualifications

  • A degree in Computer Science or equivalent or a related discipline; or equivalent work experience
  • +5 years experience Azure Data Factory and Azure services
  • Financial Services background appreciate

  • Pyspark" "Azure data bricks" "Azure Data Factory"

    7 days ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...

  • Azure Data Factory

    2 days ago

    Mumbai, India UR CFO Consultancy Pvt Ltd Full time

    JD - Responsibility - Work as part of the data conversion team to build ETL components for Data Conversions Leverage industry standards for Data Integration Development Experience / knowledge - Must 5 to 6 years of experience with Data integration with ETCL tools - Must have at least 1 to 2 years’ hands on experience with SSIS and MSSQL server - Must...

  • Snowflake Developer(AZURE DATA Factory)

    2 weeks ago

    Chennai, Mumbai, Pune, India Infyjob Technology Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Looking for a Snowflake developer with Azure Data Factory.Please dont apply those who not have Azure data factory(ADF)Please apply those who have 9+years.9+YEARSOnly the immediate joiner25lpaMumbai ,pune ,chennai

  • Data Engineer Snowflake, Azure Data Factory

    2 weeks ago

    Mumbai, India Suzva Software Technologies Full time

    JobOpening Data Engineer (Contract | 6 Months) Location: Hyderabad | Chennai | Remote Flexibility PossibleType: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake,...

  • Consultant - Azure Data Factory / Azure SQL Server / Data Modeling

    5 days ago

    Delhi, Mumbai, NCR, India KPMG Assurance and Consulting Services LLP Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job Description:Design, develop, and maintain interactive dashboards and reports using Power BI.Apply advance Power BI capabilities, including Power Query, DAX, and data modeling techniques.Lead design and development of data models, ETL processes, and data visualization components.Extract, transform, and load (ETL) data from various sources to create data...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Azure Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India Talpro Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....

  • Azure Data Factory Developer- L

    5 days ago

    Bengaluru, Hyderabad, Mumbai, India Infosys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job descriptionHiring for Azure Data Factory Developer with experience range 2 years & aboveMandatory Skills: ADF, Azure Data LakeEducation: BE/B.Tech/MCA/M.Tech/MSc./MSResponsibilitiesA day in the life of an InfoscionAs part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project...

  • Azure Data Engineer

    3 weeks ago

    Mumbai, India LTIMindtree Full time

    Skill: Azure Data Engineer Primary skill: ADB,ADF,SQL Secondary skill: Py spark or Python Experience: 5-12YRS Location: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore,Chennai Notice period: Imm to 30 Days JD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks Developer Location India IST Overview Data Engineer having good...

  • Azure data engineer

    2 weeks ago

    Mumbai, India LTIMindtree Full time

    Skill: Azure Data Engineer Primary skill: ADB, ADF, SQL Secondary skill: Py spark or Python Experience: 5-12 YRS Location: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore, Chennai Notice period: Imm to 30 Days JD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks Developer Location India IST Overview Data Engineer having good...