Azure data engineer
2 days ago
Azure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure Analysis Services, Azure Dev Ops
Experience working in ETL process for at least 8 years
Experience developing ETL process using Azure ETL tools for at least 5 years
Qualifications
Bachelor’s degree in information systems, Computer Science, Engineering, or related field
Proficient in designing and implementing datasourcing and transformation processes (ETL) in a large, distributed environmentusing cloud services e.g., Azure Data Factory, Azure Data Lake, Azure SQL Data Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure Analysis Services and Azure Dev Ops
Hands-on experience with developing complex ETLpipelines that ingest and transform data from various source systems into Azurecloud operational databases and data warehouse environment
Proficient in developing and operationalizingvarious data distribution patterns such as APIs, event based, publish/subscribemodels
Well versed with data models, source targetdefinitions, identify/fixing discrepancies adhering to enterprise datagovernance standards
Adept with Azure Dev Ops-CI/CD (Continuous Integration and Continuous Deployment) and Test-Driven Development practices
Design, develop and implement scalable batch /real-time data pipelines to integrate data from a variety of sources into an Azure database / data warehouse and data lake
Experience migrating data lakes from on-premisesto cloud
Experience with agile delivery using Azure Dev Ops
Experience monitoring performance of dataworkflows and infrastructure through use of monitoring tools and enablingalerts
Functional knowledge of data visualization tools
Responsibilities
Design and implement data frameworks andpipelines to process data from on-premises and cloud data sources to feed intothe Azure Cloud, monitor data quality and implement related controls
Evaluate existing designs, improve methods, andimplement optimizations
Analyze and validate data sharing requirementswithin and outside data partners
Analyze and interpret collected data;identifying trends; writing reports and recommendations for internal orexternal clients
Use statistical practices to analyze current andhistorical data to make predictions, identify risks, and opportunities enablingbetter decisions on planned/future events
Work with business leadership to understand datarequirements; propose and develop solutions that enable effectivedecision-making and drive business objectives
Prepare project deliverables that are valued bythe business and present them in such a manner that they are readily understoodby project stakeholders
Prepare advanced project implementation plansusing Agile methodologies, which highlight milestones and deliverables,leveraging standards, practices, and work planning tools
Recognize potential issues and risks during theanalytics project implementation and recommend mitigation strategies
Document best practices for data analysis, dataengineering, and evangelize their usages
Work with stakeholders, including the executivesas well as product engineering teams to assist with data-related technicalissues and support their data infrastructure needs
Create data tools for data scientist team toassist them in building and optimizing our product into an innovative industryleader
Work with data and analytics experts to strivefor greater functionality in our data capabilities
Experience inoffshore/ onsite coordination
-
Azure Data Engineer
1 month ago
Delhi, India Tata Consultancy Services Full timeJob Description**mandatorySNRequired InformationDetails1Role**Azure DataBricks/Data/Data Factory Enginner2Required Technical Skill Set**AzureDataBricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**Build and maintain the technology platform for both on premise...
-
Azure Data Engineer
3 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Description**mandatorySNRequired InformationDetails1Role**Azure DataBricks/Data/Data Factory Enginner2Required Technical Skill Set**AzureDataBricks/ADF EnginnerDesired Experience Range**8-11 yearsLocation of RequirementBangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**- Build and maintain the technology platform for both on...
-
Azure Data Engineer
2 months ago
delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeRole : Azure Data Engineer Required Technical Skill Set Azure Data Factory, Azure Data Bricks, Azure Streaming Analytics, Azure Storage , Azure PaaS DBs , SQL DW/DB , Event Hub, CI/CDDesired Experience Range 6+ YearsLocation of Requirement Anywhere in IndiaDesired Competencies (Technical/Behavioral Competency)Must-Have · 5+ years in a data engineer role...
-
Azure data engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role - Azure Data EngineerResponsibilities -- 8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.- Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.- Minimum 6+ years of experience in Spark,...
-
Azure Data Engineer
4 weeks ago
Delhi, India NeerInfo Solutions Full timeHiring for Fortune IT CompanyRole: Azure Data EngineerExperience: 5 to 12 YearsLocation: Pan IndiaNotice Period: Immediate to 45 days to currently servingJD:- Proficiency in Azure services: Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake.- Strong programming skills in Python, Scala, SQL, or Java.- Familiarity with big data...
-
Azure Data Engineer
4 days ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning, and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure Data Engineer
23 hours ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure data engineer
2 days ago
Delhi, India Truelancer.com Full timeJob Title: Data Engineer - FabricExperience: 5-7 YrsMandatory Skills: ADF, Databricks, Fabric, Python, SQLRequired Technical SkillsMicrosoft FabricData warehouse and lakehouse methodologies including medallion architectureData ETL/ELT processesData profiling and anomaly detectionData modeling (Dimensional/Kimball)SQL expertisePython experience (expertise...
-
Azure Data Engineer
2 months ago
Delhi, India MSRcosmos LLC Full timeAbout the Role- Azure Data EngineerResponsibilities-8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark, Spark...
-
Azure data engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization...
-
Azure Data Engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure data engineer
2 weeks ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure Data Engineer
2 days ago
Delhi, India Quantzig Full timeAbout Quantzig:Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is...
-
Azure data engineer
2 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica Power...
-
Azure Data Engineer
4 weeks ago
Delhi, India Tata Consultancy Services Full timeJob Role: Azure Data EngineerJob Location: TCS MumbaiJob Mode: Work From OfficeExperience Range: Min 5 - 7yearsDesired Competencies (Technical/Behavioral Competency):Skills:ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica PowerCenter; Azure DevOps, Azure...
-
Azure Data Engineer
3 months ago
Delhi, India Tata Consultancy Services Full timeRole :Azure Data EngineerDesired Experience Range :4 - 7 YearsLocation of Requirement :PuneMandatory Technical Skill Set :Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD.Must-Have :Microsoft Azure covering - designing, building, testing, and maintaining cloud applications and...
-
Azure Data Engineer
4 months ago
Delhi, India Databerry Technologies Pvt Ltd Full timeAs a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement dataquality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestratedvia Azure Data Factory, using...
-
Azure data engineer
3 weeks ago
Delhi, India Databerry Technologies Pvt Ltd Full timeAs a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement dataquality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestratedvia Azure Data Factory, using...