Azure Data Engineer

5 days ago

India Y&L Consulting, Inc. Full time

Skills

       Azure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure AnalysisServices, Azure DevOps

       Experience working in ETL process for at least 8 years

       Experience developing ETL process using AzureETL tools for at least 5 years


Qualifications

       Bachelor’s degree in information systems,Computer Science, Engineering, or related field

        Proficient in designing and implementing datasourcing and transformation processes (ETL) in a large, distributed environmentusing cloud services e.g., Azure Data Factory,Azure Data Lake, Azure SQL Data Warehouse, Azure Databricks, Azure Synapse,Spark, Python, Azure Analysis Services and Azure DevOps

       Hands-on experience with developing complex ETLpipelines that ingest and transform data from various source systems into Azurecloud operational databases and data warehouse environment

       Proficient in developing and operationalizingvarious data distribution patterns such as APIs, event based, publish/subscribemodels

       Well versed with data models, source targetdefinitions, identify/fixing discrepancies adhering to enterprise datagovernance standards

       Adept with Azure DevOps-CI/CD (ContinuousIntegration and Continuous Deployment) and Test-Driven Development practices

       Design, develop and implement scalable batch /real-time data pipelines to integrate data from a variety of sources into anAzure database / data warehouse and data lake

       Experience migrating data lakes from on-premisesto cloud

       Experience with agile delivery using AzureDevOps

       Experience monitoring performance of dataworkflows and infrastructure through use of monitoring tools and enablingalerts

       Functional knowledge of data visualization tools




Responsibilities

       Design and implement data frameworks andpipelines to process data from on-premises and cloud data sources to feed intothe Azure Cloud, monitor data quality and implement related controls

       Evaluate existing designs, improve methods, andimplement optimizations

       Analyze and validate data sharing requirementswithin and outside data partners

       Analyze and interpret collected data;identifying trends; writing reports and recommendations for internal orexternal clients

       Use statistical practices to analyze current andhistorical data to make predictions, identify risks, and opportunities enablingbetter decisions on planned/future events

       Work with business leadership to understand datarequirements; propose and develop solutions that enable effectivedecision-making and drive business objectives

       Prepare project deliverables that are valued bythe business and present them in such a manner that they are readily understoodby project stakeholders

       Prepare advanced project implementation plansusing Agile methodologies, which highlight milestones and deliverables,leveraging standards, practices, and work planning tools

       Recognize potential issues and risks during theanalytics project implementation and recommend mitigation strategies

       Document best practices for data analysis, dataengineering, and evangelize their usages

       Work with stakeholders, including the executivesas well as product engineering teams to assist with data-related technicalissues and support their data infrastructure needs

       Create data tools for data scientist team toassist them in building and optimizing our product into an innovative industryleader

       Work with data and analytics experts to strivefor greater functionality in our data capabilities

       Experience inoffshore/ onsite coordination



  • Azure Data Engineer

    3 months ago

    india Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 months ago

    india Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    1 month ago

    India Doryo Full time

    As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your role will involve working with various stakeholders to understand data requirements, developing data pipelines, and ensuring the reliability and performance of our data infrastructure. If you are a talented data engineer...

  • Azure data engineer

    1 month ago

    India MSRcosmos LLC Full time

    About the Role - Azure Data Engineer Responsibilities - 8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering. Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics. Minimum 6+ years of...

  • Azure Data Engineer

    2 months ago

    india Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement data quality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory,...

  • Azure Data Engineer

    1 month ago

    India Tata Consultancy Services Full time

    Job Description **mandatory SN Required Information Details 1 Role** Azure DataBricks/Data/Data Factory Enginner 2 Required Technical Skill Set** AzureDataBricks/ADF Enginner Desired Experience Range** 8-11 years Location of Requirement Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** ...

  • Azure Data Engineer

    3 months ago

    india Tata Consultancy Services Full time

    Role : Azure Data Engineer Desired Experience Range : 4 - 7 Years Location of Requirement : Pune Mandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD. Must-Have : Microsoft Azure covering - designing, building, testing, and maintaining cloud...

  • Azure Data Engineer

    2 months ago

    india Tata Consultancy Services Full time

    Role : Azure Data EngineerDesired Experience Range : 4 - 7 YearsLocation of Requirement : PuneMandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD.Must-Have :Microsoft Azure covering - designing, building, testing, and maintaining cloud applications...

  • Azure data engineer

    3 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Mumbai/Delhi/Bangalore/Chennai/Pune Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica...

  • Azure data engineer

    2 weeks ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data...

  • Azure Data Engineer

    2 months ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data...

  • Azure Data Engineer

    2 months ago

    India MSRcosmos LLC Full time

    About the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark, Spark...

  • Azure Data Engineer

    4 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica...

  • Azure Data Engineer

    4 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica...

  • Azure Data Engineer

    4 days ago

    India Truelancer.com Full time

    Job Title: Data Engineer - Fabric Experience: 5-7 Yrs Mandatory Skills: ADF, Databricks, Fabric, Python, SQL Required Technical Skills Microsoft Fabric Data warehouse and lakehouse methodologies including medallion architecture Data ETL/ELT processes Data profiling and anomaly detection Data modeling (Dimensional/Kimball) SQL expertise Python experience...

  • Azure Data Engineer

    4 days ago

    India Truelancer.com Full time

    Job Title: Data Engineer - FabricExperience: 5-7 YrsMandatory Skills: ADF, Databricks, Fabric, Python, SQLRequired Technical SkillsMicrosoft FabricData warehouse and lakehouse methodologies including medallion architectureData ETL/ELT processesData profiling and anomaly detectionData modeling (Dimensional/Kimball)SQL expertisePython experience (expertise not...

  • Azure Data Engineer

    3 weeks ago

    India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that...

  • Azure Data Engineer

    3 weeks ago

    India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization...

  • Azure Data Engineer

    5 days ago

    India Y&L Consulting, Inc. Full time

    Skills       Azure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure AnalysisServices, Azure DevOps       Experience working in ETL process for at least 8 years       Experience developing ETL process using AzureETL tools for at least 5...

  • Azure Data Engineer

    4 months ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data  quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated  via Azure Data...