Azure Data Engineer

4 days ago

India Truelancer.com Full time

Job Title: Data Engineer - Fabric

Experience: 5-7 Yrs

Mandatory Skills: ADF, Databricks, Fabric, Python, SQL


Required Technical Skills



  • Microsoft Fabric
  • Data warehouse and lakehouse methodologies including medallion architecture
  • Data ETL/ELT processes
  • Data profiling and anomaly detection
  • Data modeling (Dimensional/Kimball)
  • SQL expertise
  • Python experience (expertise not required, but would be nice)
  • Azure Databricks
  • Azure Data Factory
  • Power BI



Required Skills & Qualifications:



  • Proven experience as a Data Engineer, with a focus on data pipeline design, ETL, and data integration.
  • Strong proficiency in Azure Data Factory (ADF) for creating and managing data pipelines.
  • Experience with Databricks for building, optimizing, and deploying data pipelines and machine learning models.
  • Expertise in Microsoft Fabric for managing and integrating data solutions across the Azure ecosystem.
  • Proficiency in Python, with the ability to write clean, efficient, and reusable code.
  • Strong experience in writing and optimizing SQL queries for complex data manipulation and analysis.
  • Hands-on experience with cloud platforms (preferably Azure), data lakes, and data warehousing concepts.
  • Familiarity with data modeling, data warehousing principles, and database technologies.
  • Experience with version control (e.g., Git) and CI/CD pipelines for data engineering tasks.
  • Strong problem-solving skills, attention to detail, and ability to work independently and in a team environment.
  • Excellent communication skills and the ability to work effectively in a collaborative environment.


Key Responsibilities:



  • Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Databricks, and Microsoft Fabric.
  • Develop and implement ETL processes to collect, transform, and load data from various sources into data warehouses and data lakes.
  • Write complex SQL queries and Python scripts to manage, analyze, and manipulate large datasets.
  • Optimize data workflows, troubleshoot pipeline issues, and improve overall system performance.
  • Collaborate with data scientists, analysts, and other engineering teams to understand data requirements and deliver efficient data solutions.
  • Ensure data quality, integrity, and security in all stages of the data pipeline.
  • Monitor and optimize data storage, processing, and retrieval performance across cloud and on-premise platforms.
  • Stay up-to-date with industry trends and advancements in data engineering tools and best practices.




sudhanshu.mishra@truelancer.com

  • Azure Data Engineer

    3 months ago

    india Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 months ago

    india Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    1 month ago

    India Doryo Full time

    As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. Your role will involve working with various stakeholders to understand data requirements, developing data pipelines, and ensuring the reliability and performance of our data infrastructure. If you are a talented data engineer...

  • Azure data engineer

    1 month ago

    India MSRcosmos LLC Full time

    About the Role - Azure Data Engineer Responsibilities - 8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering. Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics. Minimum 6+ years of...

  • Azure Data Engineer

    2 months ago

    india Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement data quality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory,...

  • Azure Data Engineer

    1 month ago

    India Tata Consultancy Services Full time

    Job Description **mandatory SN Required Information Details 1 Role** Azure DataBricks/Data/Data Factory Enginner 2 Required Technical Skill Set** AzureDataBricks/ADF Enginner Desired Experience Range** 8-11 years Location of Requirement Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** ...

  • Azure Data Engineer

    3 months ago

    india Tata Consultancy Services Full time

    Role : Azure Data Engineer Desired Experience Range : 4 - 7 Years Location of Requirement : Pune Mandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD. Must-Have : Microsoft Azure covering - designing, building, testing, and maintaining cloud...

  • Azure Data Engineer

    2 months ago

    india Tata Consultancy Services Full time

    Role : Azure Data EngineerDesired Experience Range : 4 - 7 YearsLocation of Requirement : PuneMandatory Technical Skill Set : Azure Data Bricks, Python scripting, PySpark, Structured Streaming, Azure Storage, Azure Data Factory, ARM templates, DevOps CI/CD.Must-Have :Microsoft Azure covering - designing, building, testing, and maintaining cloud applications...

  • Azure data engineer

    3 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: Mumbai/Delhi/Bangalore/Chennai/Pune Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica...

  • Azure Data Engineer

    2 months ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data...

  • Azure data engineer

    2 weeks ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data...

  • Azure Data Engineer

    2 months ago

    India MSRcosmos LLC Full time

    About the Role - Azure Data EngineerResponsibilities -8+ years of experience in designing and implementing data solutions with at least 4+ years of experience in Azure data engineering.Extensive experience with Databricks, including a deep understanding of its architecture, data modeling, and real-time analytics.Minimum 6+ years of experience in Spark, Spark...

  • Azure Data Engineer

    4 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica...

  • Azure Data Engineer

    4 weeks ago

    India Tata Consultancy Services Full time

    Job Role: Azure Data Engineer Job Location: TCS Mumbai Job Mode: Work From Office Experience Range: Min 5 - 7 years Desired Competencies (Technical/Behavioral Competency): Skills: ADF, ADLS, ADB, Data Bricks, Python/Scala, SQL, Synapse, Power BI, C #, Informatica Data Governance Champions Enablement, Informatica IICS, Informatica...

  • Azure Data Engineer

    4 days ago

    India Truelancer.com Full time

    Job Title: Data Engineer - Fabric Experience: 5-7 Yrs Mandatory Skills: ADF, Databricks, Fabric, Python, SQL Required Technical Skills Microsoft Fabric Data warehouse and lakehouse methodologies including medallion architecture Data ETL/ELT processes Data profiling and anomaly detection Data modeling (Dimensional/Kimball) SQL expertise Python experience...

  • Azure Data Engineer

    3 weeks ago

    India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that...

  • Azure Data Engineer

    3 weeks ago

    India Quantzig Full time

    About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization...

  • Azure Data Engineer

    5 days ago

    India Y&L Consulting, Inc. Full time

    Skills        Azure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure AnalysisServices, Azure DevOps        Experience working in ETL process for at least 8 years        Experience developing ETL process using AzureETL tools for at least 5 years Qualifications ...

  • Azure Data Engineer

    6 days ago

    India Y&L Consulting, Inc. Full time

    Skills       Azure Data Factory, Azure Data Lake, Azure SQLData Warehouse, Azure Databricks, Azure Synapse, Spark, Python, Azure AnalysisServices, Azure DevOps       Experience working in ETL process for at least 8 years       Experience developing ETL process using AzureETL tools for at least 5...

  • Azure Data Engineer

    4 months ago

    India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will: Implement continuous improvements to our data governance practices and implement data  quality improvements. Partner with key stakeholders to understand and refine data product requirements. Design and develop reliable data product pipelines that transform data at scale, orchestrated  via Azure Data...