Azure data engineer
2 days ago
Experience: 5-7 Yrs
Mandatory Skills: ADF, Databricks, Fabric, Python, SQL
Required Technical Skills
Microsoft Fabric
Data warehouse and lakehouse methodologies including medallion architecture
Data ETL/ELT processes
Data profiling and anomaly detection
Data modeling (Dimensional/Kimball)
SQL expertise
Python experience (expertise not required, but would be nice)
Azure Databricks
Azure Data Factory
Power BI
Required Skills & Qualifications:
Proven experience as a Data Engineer, with a focus on data pipeline design, ETL, and data integration.
Strong proficiency in Azure Data Factory (ADF) for creating and managing data pipelines.
Experience with Databricks for building, optimizing, and deploying data pipelines and machine learning models.
Expertise in Microsoft Fabric for managing and integrating data solutions across the Azure ecosystem.
Proficiency in Python, with the ability to write clean, efficient, and reusable code.
Strong experience in writing and optimizing SQL queries for complex data manipulation and analysis.
Hands-on experience with cloud platforms (preferably Azure), data lakes, and data warehousing concepts.
Familiarity with data modeling, data warehousing principles, and database technologies.
Experience with version control (e.g., Git) and CI/CD pipelines for data engineering tasks.
Strong problem-solving skills, attention to detail, and ability to work independently and in a team environment.
Excellent communication skills and the ability to work effectively in a collaborative environment.
Key Responsibilities:
Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Databricks, and Microsoft Fabric.
Develop and implement ETL processes to collect, transform, and load data from various sources into data warehouses and data lakes.
Write complex SQL queries and Python scripts to manage, analyze, and manipulate large datasets.
Optimize data workflows, troubleshoot pipeline issues, and improve overall system performance.
Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver efficient data solutions.
Ensure data quality, integrity, and security in all stages of the data pipeline.
Monitor and optimize data storage, processing, and retrieval performance across cloud and on-premise platforms.
Stay up-to-date with industry trends and advancements in data engineering tools and best practices.
-
Azure Data Engineer
1 month ago
Delhi, India Tata Consultancy Services Full timeJob Description**mandatorySNRequired InformationDetails1Role**Azure DataBricks/Data/Data Factory Enginner2Required Technical Skill Set**AzureDataBricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**Build and maintain the technology platform for both on premise...
-
Azure Data Engineer
3 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Description**mandatorySNRequired InformationDetails1Role**Azure DataBricks/Data/Data Factory Enginner2Required Technical Skill Set**AzureDataBricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**- Build and maintain the technology platform for both on...
-
Azure Data Engineer
2 months ago
delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole : Azure Data Engineer Required Technical Skill Set Azure Data Factory, Azure Data Bricks, Azure Streaming Analytics, Azure Storage , Azure PaaS DBs , SQL DW/DB , Event Hub, CI/CDDesired Experience Range 6+ YearsLocation of Requirement Anywhere in IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have · 5+ years in a data engineer role...
-
Azure data engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -- 8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.- Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.- Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
4 weeks ago
Delhi, India NeerInfo Solutions Full timeHiring for Fortune IT CompanyRole: Azure Data EngineerExperience: 5 to 12 YearsLocation: Pan IndiaNotice Period: Immediate to 45 days to currently servingJD:- Proficiency in Azure services: Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake.- Strong programming skills in Python, Scala, SQL, or Java.- Familiarity with big data...
-
Azure Data Engineer
4 days ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning, and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure Data Engineer
24 hours ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure Data Engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role- Azure Data EngineerResponsibilities-8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark, Spark...
-
Azure data engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization...
-
Azure Data Engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure data engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure Data Engineer
2 days ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure data engineer
2 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica Power...
-
Azure Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: Azure Data EngineerJob Location: TCS MumbaiJob Mode: Work From OfficeExperience Range: Min 5 - 7yearsDesired Competencies (Technical/Behavioral Competency):Skills:ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica PowerCenter; Azure DevOps, Azure...
-
Azure data engineer
2 days ago
Delhi, India Y&L Consulting, Inc. Full timeSkillsAzure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure Analysis Services, Azure Dev OpsExperience working in ETL process for at least 8 yearsExperience developing ETL process using Azure ETL tools for at least 5 yearsQualificationsBachelor’s degree in information systems, Computer Science,...
-
Azure Data Engineer
3 months ago
Delhi, India Tata Consultancy Services Full timeRole :Azure Data EngineerDesired Experience Range :4 - 7 YearsLocation of Requirement :PuneMandatory Technical Skill Set :Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD.Must-Have :Microsoft Azure covering - designing, building, testing, and maintaining cloud applications and...
-
Azure Data Engineer
4 months ago
Delhi, India Databerry Technologies Pvt Ltd Full timeAs a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement dataquality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestratedvia Azure Data Factory, using...
-
Azure data engineer
3 weeks ago
Delhi, India Databerry Technologies Pvt Ltd Full timeAs a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement dataquality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestratedvia Azure Data Factory, using...