Azure Data Factory
2 days ago
Role & responsibilities
The Azure Data Factory Engineer is responsible for designing, implementing, and maintaining scalable data integration solutions using Azure Data Factory (ADF). This includes setting up and configuring Azure infrastructure components, integrating diverse data sources including REST APIs, and implementing CI/CD pipelines to support robust, secure, and automated data workflows.
Preferred candidate profile
- Design and develop ETL/ELT pipelines using Azure Data Factory.
- Set up and configure Azure infrastructure including resource groups, storage accounts, integration runtimes, and networking components.
- Integrate data from various sources including REST APIs, databases, and cloud storage, ensuring secure authentication (e.g., OAuth2, Managed Identity, API keys).
- Implement CI/CD pipelines for ADF using tools like Azure DevOps, Git, and infrastructure-as-code (ARM templates, Terraform).
- Collaborate with data architects and business stakeholders to understand data requirements.
- Monitor and optimize pipeline performance and troubleshoot issues.
- Apply security best practices for data access and infrastructure.
- Maintain documentation and ensure compliance with data governance policies.
Technical:
- +5 years experience Azure Data Factory and Azure services
- Strong experience with Azure Data Factory and Azure services (e.g., Azure Storage, Azure SQL, Key Vault).
- Proficiency in data integration, transformation, and orchestration.
- Experience with CI/CD tools and practices for ADF deployments.
- Familiarity with infrastructure-as-code tools (ARM, Terraform).
- Knowledge of REST API integration and authentication methods (OAuth2, API keys, Managed Identity).
- Understanding of networking, identity management, and security in Azure.
- Experience with DevOps practices and automation.
Behavioral Skills:
- Excellent interpersonal and communication skills for working in a global environment
- Experience working with technical support team(s).
- Being customer oriented.
- Very good English (speaking/writing) skills.
- Willingness to learn and quickly adapt to changing requirements
- Proactive approach to identifying issues and presenting solutions and options
- Prioritize business impact and urgency
- Ability to learn new technology and methodology quickly.
Soft Skills:
- Very good knowledge to handle Application Support and Maintenance projects with different skill sets.
- Good analytic skills and problem solving skills in short span of time.
- Very good communication and presentation skills.
- Ability to work in a team
- conflict skills
- flexibility
- initiative
- resilience
Previous Experience & Qualifications
- A degree in Computer Science or equivalent or a related discipline; or equivalent work experience
- +5 years experience Azure Data Factory and Azure services
- Financial Services background appreciate
-
Mumbai, Maharashtra, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJobOpening Data Engineer (Contract | 6 Months)Location: Hyderabad | Chennai | Remote Flexibility PossibleType: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake,...
-
Azure Data Bricks Engineer
2 weeks ago
Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAzure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Prointegrate World It Consulting Full time ₹ 9,00,000 - ₹ 12,00,000 per yearKey Responsibilities:Design, build, and maintain robust data pipelines to curate and ingest data efficiently.Work with Azure cloud services to deploy and manage scalable data solutions.Implement and maintain CI/CD pipelines for seamless data workflows.Collaborate with cross-functional teams to ensure data integrity, security, and accessibility.Key Skills &...
-
Azure Data Architect
1 day ago
Mumbai, Maharashtra, India Sidan Global Solutions Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Job Title : Azure Data Architect / Data Architect Location : Mumbai (Airoli) Work Mode : Hybrid (3 Days Work from Office) Shift : UK Shift Experience : 10 Years Employment Type : Full-Time About the Company : At Sidan Global, we are committed to delivering innovative technology and data-driven solutions that empower enterprises to...
-
Azure Data Architect
1 day ago
Mumbai, Maharashtra, India Infogain Full time ₹ 20,00,000 - ₹ 25,00,000 per yearROLES & RESPONSIBILITIESStrong Skill in Palantir,Strong SQL, Python, and data engineering backgroundHands-on experience in Foundry data pipelines and ontologyGood knowledge of data visualization and operational workflowsAwareness of cloud, governance, and DevOps conceptsData modeling, schema design, data lineage, metadata managementAPIs, RESTful services,...
-
Microsoft Azure, Databricks
3 days ago
Mumbai, Maharashtra, India Natobotics Full time ₹ 20,00,000 - ₹ 25,00,000 per yearHi ConnectionsWe are Hiringhashtag#MicrosoftAzure, Digital: Python for Data Science, Digital: Databricks, Digital: PySpark, Azure Data Factory # Immediate Joiners Job Title: Developer Work Location: Mumbai, MH / Hyderabad, TG / Chennai, TN / Bhubaneswar, OR / Bangalore, KA Skill Required: Digital: Microsoft Azure, Digital: Python for Data Science, Digital:...
-
Azure Data Engineer
1 week ago
Mumbai, Maharashtra, India Infogain Full time US$ 90,000 - US$ 1,20,000 per yearRoles & ResponsibilitiesJob Description:ResponsibilitiesDevelop a detailed project plan outlining tasks, timelines, milestones, and dependencies.Solutions architecture design and implementationUnderstand the source and outline the ADF structure. Design and schedule packages using ADF.Foster collaboration and communication within the team to ensure smooth...
-
Azure data Engineer
4 weeks ago
Mumbai, Maharashtra, India, Maharashtra Tata Consultancy Services Full timeRole: Azure data EngineerExperience: 4Location: MumbaiMust-Have4+ years of hands-on experience in development.Azure – cloud technology – Function Apps, API, Azure DevOps, Databricks, Data Factory Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code versioning tool GIT/SVN/others...
-
Azure Data Engineer
4 weeks ago
Mumbai, Maharashtra, India, Maharashtra Deloitte Full timeYour potential, unleashed.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.At Deloitte, your whole self to work, every day. Combine that with our...
-
Data Engineer
4 days ago
Mumbai, Maharashtra, India Coffeee Full time ₹ 15,00,000 - ₹ 28,00,000 per yearResponsibilitiesResponsible for day-to-day tasks related to data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Work with Azure Data Factory (ADF) and Databricks to design, develop, and maintain data pipelines and data platforms.Build operational and automated dashboards, reports with help of Power BI and other...