Azure Data Engineer
1 month ago
About the job :
Ideal Candidate :
- 3+ years in Azure Data Engineering
- Very good at ADF (Azure Data Factory)
- Hands-on experience in designing and implementing data solutions on Azure
Organization :
A global provider of Automation solutions in Assembly, Inspection, and Testing for manufacturing industries.
With a mission to enhance the efficiency of the manufacturing processes of their customers by providing innovative technological solutions.
Over the last 16+ years, they have been providing automation solutions that are scalable and cost-effective.
Roles And Responsibilities :
We are seeking an experienced Azure Data Engineer with 4 to 5 years of hands-on experience in Azure Data Factory (ADF), Databricks, and Python.
In this role, you will be responsible for designing, implementing, and managing data solutions on Microsoft Azure, with a specific focus on ADF, Databricks, and Python scripting.
You will collaborate with cross-functional teams to gather data requirements, develop efficient data pipelines, and ensure data quality and integrity.
Key Responsibilities :
- Design and implement data solutions on Azure using ADF, Databricks, Stream Analytics / Spark
- Develop and optimize data pipelines to extract, transform, and load data from various sources into Azure data lakes
- Collaborate with data architects and business stakeholders to understand data requirements and translate them into technical solutions.
- Implement data integration and data transformation processes using ADF and Databricks.
- Perform data profiling, validation, and cleansing activities to ensure data accuracy and consistency.
- Develop and maintain data orchestration workflows and scheduling using ADF.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
- Optimize data storage and retrieval processes for performance and cost-efficiency.
- Implement data security and privacy measures, including data encryption and access controls.
- Document technical specifications, data mappings, and data lineage for future reference.
Candidate :
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 3 to 5 years of hands-on experience in designing and implementing data solutions on Azure, with a focus on ADF, Databricks, Stream Analytics / Spark
- Strong proficiency in ADF, including pipeline development, data integration, and orchestration.
- Experience with Databricks for data transformation, ETL processes, and data analytics.
- Proficiency in Python scripting for data manipulation, transformation, and automation.
- Solid understanding of data modeling, data warehousing concepts, and data integration patterns.
- Experience with data profiling, data quality management, and data governance practices.
- Familiarity with Azure services like Azure Data Lake Storage, Azure SQL Database, and Azure Cosmos DB.
- Strong analytical and problem-solving skills with the ability to troubleshoot and resolve data-related issues.
- Excellent communication and collaboration skills to work effectively with cross-functional teams.
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full timeJob Title: Azure Data Engineer. Location: Bangalore, India. Experience Level: 4-8 years. Job Description:. We are looking for an experienced Azure Data Engineer to join our team in Bangalore. As an Azure Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and solutions using Azure Data Factory,...
-
Bangalore, Karnataka, India CGI Full timeJob Title : Azure Data EngineerExperience : 4 to 10 yearsCategory : Software Development/ EngineeringLocation : Bangalore onlyNotice Period: Immediate / Max 30 DaysEmployment Type : Full TimeQualifying Criteria :- 4+ years of experience in Azure Data Engineer - ADF, ADB, ADLS- Notice period / Joining duration - Immediately / Less than 30 Days- Willing to...
-
TE Connectivity
3 days ago
Bangalore, Karnataka, India TE Connectivity India Private Limited Full timeAbout the job :At TE, you will unleash your potential working with people from diverse backgrounds and industries to create a safer, sustainable and more connected world.Job Overview :- Responsible for designing and establishing the solution architecture for analytical platforms and/or data-enabled solutions.- Has broad understanding of the entire data and...
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Top Talent Technologies Private Limited Full timeRequirements : Will likely have a degree in Computer Science, Statistics, Informatics, Information Technology, or quantitative field.Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage)Excellent communication skills with the ability to work within a team, across the business, and build strong...
-
Azure Data Engineer
4 weeks ago
Bangalore, Karnataka, India Smart Consulting - Creating Future Leaders Full timeEARLY JOINERS WILL BE PREFERABLE. Company : BIG 4 MNC. Role : Azure Data Engineer. Location : Bangalore. Experience : 3-8 Years. CTC : 22 LPA Max (Depends on current CTC, experience, skills). Mandatory skills : Azure, Azure Cloud, Azure Databricks, Azure Datafactory, Azure Datalake, Python, SQL, Relational databases (Oracle, DB2, SQL Server), Spark, Agile....
-
Azure Databricks Engineer
1 month ago
Bangalore, Karnataka, India ARR Recruitment Solutions Full timeAzure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data...
-
Azure Data Engineer
1 month ago
Bangalore, Karnataka, India Infiniti Research Full timeCompany: Quantzig Analytics. Job Role : Azure Data Engineer. About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. We have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent...
-
Senior Data Engineer
3 weeks ago
Bangalore, Karnataka, India GLAXOSMITHKLINE ASIA PVT. LTD Full timeA new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...
-
Azure Engineer
1 month ago
Bangalore, Karnataka, India NUSTAR TECHNOLOGIES INDIA PRIVATE LIMITED Full timeMust Have :Ensuring data security and privacy prerequisites are followed :- Developing and maintaining data models and schemas- Optimizing data processing performance through tuning and monitoring- Building and maintaining data pipelines for data integration and processing- Designing and implementing data storage solutions on Azure- Strong design and data...
-
Cloud Engineer
3 weeks ago
Bangalore, Karnataka, India Andor Tech Full timeExperience Required: 5+ YearsImmediate Joiners Preferred: Max 15 Design, deploy, and maintain cloud-based solutions on the Azure platform, including Azure Databricks, Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.- Develop and optimize software applications and scripts using Python, SQL, PySpark, and Unix scripting to...
-
Lead Data Engineer
1 month ago
Bangalore, Karnataka, India Infiniti Research Full timeAbout Quantzig :Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India.We have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and...
-
Azure Data Engineer
1 month ago
Bangalore, Karnataka, India OrangeShark Full timeAzure Data Engineer (Data Engineer, T-SQL/MS SQL/Azure SQL, Azure Devops)Location: BangaloreExperience: 5 - 10 Years Responsibilities:- Active member of the data engineering team- Conduct full lifecycle analysis to include requirements, activities, and design- Build data flows for data acquisition, aggregation, and modelling, using both batch and streaming...
-
Python Data Engineer
1 month ago
Bangalore, Karnataka, India TERRAGIG LLP Full timeWe are searching for a highly skilled Data Engineering Specialist to join our growing team. In this role, you will play a critical role in supporting our data science team by building and maintaining efficient data pipelines and infrastructure. Your expertise in Python and cloud technologies will be instrumental in ensuring the smooth flow of data and...
-
ADC Data Engineering Lead
1 month ago
Bangalore, Karnataka, India Growel Softech Pvt. Ltd. Full timeJob Description:We are seeking an experienced ADC (Advanced Data Computing) Data Engineering Lead with 10-13 years of experience to join our team. The ideal candidate will have a strong background in Big Data engineering, with expertise in tools such as Databricks, Azure Data Factory, and SQL. As an ADC Data Engineering Lead, you will be responsible for...
-
Bangalore, Karnataka, India Thoucentric Technology Pvt. Ltd. Full timeJob Description :Roles & Responsibilities :- Implement robust data pipeline using Microsoft Stack.- Create reusable and scalable data pipelines.- Development and deployment of new data platforms.- Leverage Azure BI services for development of Big Data Platforms.- Work closely with the Product Owners and Architects to develop Azure Data Platforms.- Work with...
-
Python Data Engineer
1 month ago
Bangalore, Karnataka, India Cyitechsearch Full timeAbout the job : We are hiring for Python Data Engineer Experience : 5 to 7 years Work Time : IST Responsibility : - The Data Science team needs assistance with engineering around their Data Science work.- The focus is on Engineering more than Data Science.- The Data Science team is very strong, but what they need is engineering help without having to explain...
-
Bangalore, Karnataka, India Solutionec Pvt Ltd Full timeWe are seeking a seasoned Data Engineering Lead to join our team, focusing on leveraging data to drive strategic decisions within the pharmaceutical industry. The ideal candidate will possess a deep understanding of SQL Server, Snowflake, ETL technologies, and pharma datasets, along with proven experience in designing database architectures and leading a...
-
Azure Engineer
1 month ago
Bangalore, Karnataka, India Onward Technologies Limited Full timeJob Description :- Develop scripts to process both structured and unstructured data, ensuring efficient data processing and management.- Recommend, develop, and implement strategies to improve data reliability, efficiency, and quality, driving continuous improvement in our data processes.- Support the translation of business needs into technical system...
-
Microsoft Azure Data Engineer
1 month ago
Bangalore, Karnataka, India Randstad India Full timeJob Title : Microsoft Azure Data Services. Location : PAN INDIA. Experience : 8 -10 Years. Roles & Responsibilities :- Design, build, and configure applications to meet business process and application requirements using Microsoft Azure Data Services.- Collaborate with cross-functional teams to deliver impactful data-driven solutions.- Develop and maintain...
-
Azure Data Engineer
3 weeks ago
Bangalore, Karnataka, India Infiniti Research Full timeAbout Quantzig : Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built...