Azure Data Factory

20 hours ago

Mumbai, Maharashtra, India ERGO Technology & Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Role & responsibilities

The Azure Data Factory Engineer is responsible for designing, implementing, and maintaining scalable data integration solutions using Azure Data Factory (ADF). This includes setting up and configuring Azure infrastructure components, integrating diverse data sources including REST APIs, and implementing CI/CD pipelines to support robust, secure, and automated data workflows.

Preferred candidate profile

  • Design and develop ETL/ELT pipelines using Azure Data Factory.
  • Set up and configure Azure infrastructure including resource groups, storage accounts, integration runtimes, and networking components.
  • Integrate data from various sources including REST APIs, databases, and cloud storage, ensuring secure authentication (e.g., OAuth2, Managed Identity, API keys).
  • Implement CI/CD pipelines for ADF using tools like Azure DevOps, Git, and infrastructure-as-code (ARM templates, Terraform).
  • Collaborate with data architects and business stakeholders to understand data requirements.
  • Monitor and optimize pipeline performance and troubleshoot issues.
  • Apply security best practices for data access and infrastructure.
  • Maintain documentation and ensure compliance with data governance policies.

Technical:

  • +5 years experience Azure Data Factory and Azure services
  • Strong experience with Azure Data Factory and Azure services (e.g., Azure Storage, Azure SQL, Key Vault).
  • Proficiency in data integration, transformation, and orchestration.
  • Experience with CI/CD tools and practices for ADF deployments.
  • Familiarity with infrastructure-as-code tools (ARM, Terraform).
  • Knowledge of REST API integration and authentication methods (OAuth2, API keys, Managed Identity).
  • Understanding of networking, identity management, and security in Azure.
  • Experience with DevOps practices and automation.

Behavioral Skills:

  • Excellent interpersonal and communication skills for working in a global environment
  • Experience working with technical support team(s).
  • Being customer oriented.
  • Very good English (speaking/writing) skills.
  • Willingness to learn and quickly adapt to changing requirements
  • Proactive approach to identifying issues and presenting solutions and options
  • Prioritize business impact and urgency
  • Ability to learn new technology and methodology quickly.

Soft Skills:

  • Very good knowledge to handle Application Support and Maintenance projects with different skill sets.
  • Good analytic skills and problem solving skills in short span of time.
  • Very good communication and presentation skills.
  • Ability to work in a team
  • conflict skills
  • flexibility
  • initiative
  • resilience

Previous Experience & Qualifications

  • A degree in Computer Science or equivalent or a related discipline; or equivalent work experience
  • +5 years experience Azure Data Factory and Azure services
  • Financial Services background appreciate

  • Pyspark" "Azure data bricks" "Azure Data Factory"

    2 weeks ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Please find below JD for the same as requested. Technical Skills:"Pyspark" "Azure data bricks" "Azure Data Factory"Experienced level - 5 yearsShould have hands-on experience in writing PySpark code on Databricks and expertise in Spark-Sql and Python coding as well. Should have worked on Azure Data lake Gen2 storage or good to have knowledgeHands-on exp in...

  • Data Engineer Snowflake, Azure Data Factory

    16 hours ago

    Mumbai, Maharashtra, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    JobOpening Data Engineer (Contract | 6 Months)Location: Hyderabad | Chennai | Remote Flexibility PossibleType: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake,...

  • Azure Data Bricks Engineer

    2 weeks ago

    Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...

  • Azure Data Engineer

    1 week ago

    Mumbai, Maharashtra, India Prointegrate World It Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Key Responsibilities:Design, build, and maintain robust data pipelines to curate and ingest data efficiently.Work with Azure cloud services to deploy and manage scalable data solutions.Implement and maintain CI/CD pipelines for seamless data workflows.Collaborate with cross-functional teams to ensure data integrity, security, and accessibility.Key Skills &...

  • Azure Data Architect

    16 hours ago

    Mumbai, Maharashtra, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ROLES & RESPONSIBILITIESStrong Skill in Palantir,Strong SQL, Python, and data engineering backgroundHands-on experience in Foundry data pipelines and ontologyGood knowledge of data visualization and operational workflowsAwareness of cloud, governance, and DevOps conceptsData modeling, schema design, data lineage, metadata managementAPIs, RESTful services,...

  • Microsoft Azure, Databricks

    2 days ago

    Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Hi ConnectionsWe are Hiringhashtag#MicrosoftAzure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners Job Title: Developer Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital:...

  • Azure Data Engineer

    6 days ago

    Mumbai, Maharashtra, India Infogain Full time US$ 90,000 - US$ 1,20,000 per year

    Roles & ResponsibilitiesJob Description:ResponsibilitiesDevelop a detailed project plan outlining tasks, timelines, milestones, and dependencies.Solutions architecture design and implementationUnderstand the source and outline the ADF structure. Design and schedule packages using ADF.Foster collaboration and communication within the team to ensure smooth...

  • Azure Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Deloitte Full time

    Your potential, unleashed. India's impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond. At Deloitte, your whole self to work, every day. Combine that with our...

  • Only 24h Left Azure data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: MumbaiMust-Have- 4+ years of hands-on experience in development.- Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory- Strong knowledge Incident, problem, Change management, service management, service request.- Must have hands on experience code versioning tool...

  • Azure data Engineer

    3 days ago

    Mumbai, Maharashtra, India, Maharashtra Tata Consultancy Services Full time

    Role: Azure data EngineerExperience: 4Location: MumbaiMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code versioning tool GIT/SVN/others...