
Azure Data Factory
1 day ago
Role & responsibilities
The Azure Data Factory Engineer is responsible for designing, implementing, and maintaining scalable data integration solutions using Azure Data Factory (ADF). This includes setting up and configuring Azure infrastructure components, integrating diverse data sources including REST APIs, and implementing CI/CD pipelines to support robust, secure, and automated data workflows.
Preferred candidate profile
- Design and develop ETL/ELT pipelines using Azure Data Factory.
- Set up and configure Azure infrastructure including resource groups, storage accounts, integration runtimes, and networking components.
- Integrate data from various sources including REST APIs, databases, and cloud storage, ensuring secure authentication (e.g., OAuth2, Managed Identity, API keys).
- Implement CI/CD pipelines for ADF using tools like Azure DevOps, Git, and infrastructure-as-code (ARM templates, Terraform).
- Collaborate with data architects and business stakeholders to understand data requirements.
- Monitor and optimize pipeline performance and troubleshoot issues.
- Apply security best practices for data access and infrastructure.
- Maintain documentation and ensure compliance with data governance policies.
Technical:
- +5 years experience Azure Data Factory and Azure services
- Strong experience with Azure Data Factory and Azure services (e.g., Azure Storage, Azure SQL, Key Vault).
- Proficiency in data integration, transformation, and orchestration.
- Experience with CI/CD tools and practices for ADF deployments.
- Familiarity with infrastructure-as-code tools (ARM, Terraform).
- Knowledge of REST API integration and authentication methods (OAuth2, API keys, Managed Identity).
- Understanding of networking, identity management, and security in Azure.
- Experience with DevOps practices and automation.
Behavioral Skills:
- Excellent interpersonal and communication skills for working in a global environment
- Experience working with technical support team(s).
- Being customer oriented.
- Very good English (speaking/writing) skills.
- Willingness to learn and quickly adapt to changing requirements
- Proactive approach to identifying issues and presenting solutions and options
- Prioritize business impact and urgency
- Ability to learn new technology and methodology quickly.
Soft Skills:
- Very good knowledge to handle Application Support and Maintenance projects with different skill sets.
- Good analytic skills and problem solving skills in short span of time.
- Very good communication and presentation skills.
- Ability to work in a team
- conflict skills
- flexibility
- initiative
- resilience
Previous Experience & Qualifications
- A degree in Computer Science or equivalent or a related discipline; or equivalent work experience
- +5 years experience Azure Data Factory and Azure services
- Financial Services background appreciate
-
Azure Data Factory Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeDataFactory Full time ₹ 40,00,000 - ₹ 80,00,000Job Opportunity: Azure Data Factory Specialist">We are seeking an experienced consultant with hands-on expertise in designing, building, and maintaining scalable and secure Azure Data Factory pipelines for ETL and ELT processes.">The ideal candidate will integrate data from multiple sources, optimize pipelines for performance, scalability, and cost...
-
Mumbai, Maharashtra, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJobOpening Data Engineer (Contract | 6 Months)Location: Hyderabad | Chennai | Remote Flexibility PossibleType: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake,...
-
Azure Data Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Job Title: Azure Data ArchitectOverview:We are seeking a proactive data architect to design and implement innovative data solutions using Azure Databricks and Python. The primary focus will be on providing cost-effective solutions that optimize resource utilization.Main Responsibilities:Developing data pipelines using Azure Data Factory (ADF) and...
-
Azure Data Bricks Engineer
2 weeks ago
Mumbai, Maharashtra, India CARBYNETECH Full time ₹ 8,00,000 - ₹ 12,00,000 per yearAzure Data Factory: Develop Azure Data Factory Objects - ADF pipeline, configuration, parameters, variables, Integration services runtime Hands-on knowledge of ADF activities(such as Copy, SP, lkp etc) and DataFlows ADF data Ingestion and Integration with other services Azure Databricks: Experience in Big Data components such as Kafka, Spark SQL,...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Celebal Technologies Full time US$ 1,00,000 - US$ 1,50,000 per yearOverview: As a Data Engineer you will work with multiple teams to deliver solutions on the Azure Cloud using core cloud data warehouse tools (Azure Data Factory, Azure Databricks, Azure Synapse Analytics and other Big Data related technologies). In addition to building the next generation of application data platforms (not infrastructure) and/or improving...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India LTIMindtree Full timeSkill: Azure Data EngineerPrimary skill: ADB,ADF,SQLSecondary skill: Py spark or PythonExperience: 5-12YRSLocation: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore,ChennaiNotice period: Imm to 30 DaysJD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks DeveloperLocation India ISTOverview Data Engineer having good experience on Azure...
-
Azure Data Engineer
1 week ago
Mumbai, Maharashtra, India LTIMindtree Full timeSkill: Azure Data Engineer Primary skill: ADB,ADF,SQL Secondary skill: Py spark or Python Experience: 5-12YRS Location: Hyderabad, Pune, Mumbai, Kolkata, Nagpur, Bangalore,Chennai Notice period: Imm to 30 Days JD: Proactive Q2 Azure Data Factory ADFP3 Job Description Azure Databricks Developer Location India IST Overview Data Engineer having good experience...
-
Azure Data Solutions Engineer
2 weeks ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878Job Title: Data ArchitectWe are seeking a skilled Data Architect to join our team.As a Data Architect, you will be responsible for designing and implementing data solutions that meet the needs of our organization. This includes defining data models, developing data pipelines, and ensuring data quality and integrity.The ideal candidate will have experience...
-
Azure Data Engineer
2 weeks ago
Mumbai, Maharashtra, India Prointegrate World It Consulting Full time ₹ 1,04,000 - ₹ 1,30,878 per yearKey Responsibilities:Design, build, and maintain robust data pipelines to curate and ingest data efficiently.Work with Azure cloud services to deploy and manage scalable data solutions.Implement and maintain CI/CD pipelines for seamless data workflows.Collaborate with cross-functional teams to ensure data integrity, security, and accessibility.Key Skills &...
-
Azure Data Architect
2 weeks ago
Mumbai, Maharashtra, India Infogain Full time US$ 1,50,000 - US$ 2,00,000 per yearRoles & ResponsibilitiesCore SkillsIn-depth knowledge of Azure data services such as Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.Experience in designing and implementing scalable data solutions.Proficiency in data modeling and database design.Understanding of data governance and security practices.Experience12-14 YearsSkillsPrimary...