Azure Data Engineer

1 month ago

Hyderabad, India HireIT Consultants Full time

Job Title : Azure Data Engineer

Job Type : Full-time / Contract

Experience : 5+ Years

About the Role :

We are seeking a skilled Azure Data Engineer with hands-on experience in Azure Data Factory (ADF), Power BI, Azure Synapse Analytics, and PySpark to join our growing data engineering team. The ideal candidate will have a strong background in cloud-based data engineering, data transformation, and data visualization, with a passion for building scalable and efficient data pipelines.

As an Azure Data Engineer, you will be responsible for developing and managing data integration workflows, designing and optimizing data models, and ensuring the successful delivery of data solutions. You will collaborate with data scientists, business analysts, and other stakeholders to create end-to-end data solutions that support analytics, reporting, and business intelligence.

Key Responsibilities :

- Design, implement, and maintain data pipelines using Azure Data Factory (ADF) to move and transform data across various sources and destinations.

- Leverage Azure Synapse Analytics for building and optimizing data warehousing solutions, and implement real-time and batch data processing strategies.

- Develop data models, structures, and workflows using PySpark for large-scale data processing and analytics.

- Create interactive Power BI reports and dashboards for data visualization and business insights.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications for data solutions.

- Ensure data quality, integrity, and security across all stages of the data pipeline.

- Optimize and tune data pipeline performance, monitor data pipeline jobs, and troubleshoot issues.

- Implement best practices for data engineering processes, including data governance, scalability, and automation.

- Provide technical leadership and guidance on Azure Data Engineering technologies to junior engineers and other team members.

Required Skills and Qualifications :

- 5+ years of experience as a Data Engineer or in a related role.

- Strong expertise in Azure Data Factory (ADF), with hands-on experience in designing and orchestrating data pipelines.

- Proven experience with Azure Synapse Analytics, including data warehousing, analytics, and integration with other Azure services.

- Proficiency in PySpark for distributed data processing and building scalable data processing solutions.

- Hands-on experience with Power BI for building interactive reports and dashboards for data-driven insights.

- Strong SQL skills and experience with data modeling, transformations, and querying large datasets.

- Solid understanding of ETL processes, data integration, and data governance.

- Familiarity with Azure services like Azure Blob Storage, Azure SQL Database, Azure Data Lake, and Azure Databricks is a plus.

- Experience with data version control, deployment, and automation tools.

- Excellent problem-solving skills and the ability to troubleshoot complex data pipeline issues.

- Strong communication skills with the ability to work effectively with both technical and non-technical teams.

Preferred Qualifications :

- Experience with Azure Databricks and Spark clusters for big data processing.

- Familiarity with Azure Machine Learning or other advanced analytics tools.

- Knowledge of DevOps practices and CI/CD pipelines for automating data pipeline deployments.

- Experience with agile methodologies and working in agile teams.

(ref:hirist.tech)

  • Data Engineer

    1 month ago

    Hyderabad, India NTT DATA Full time

    Job Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...

  • Azure data engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 month ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 month ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Data Engineer

    4 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Title : Azure Data EngineerExperience : 5+ years as Azure Data EngineerLocation : HyderabadAt our company, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    6 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 hours ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: Hyderabad/BengaluruJob Description:Technical Requirements Gathering and Development of Functional Specifications.Design, develop, and maintain scalable data pipelines and ETL processes using Azure...

  • Azure Data Engineer

    3 months ago

    Hyderabad, India ProArch Full time

    ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven...

  • Data Engineer

    3 months ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner. - Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements. - Develop and implement data integration processes, frequently using Azure Data Factory,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Madhees Techno Full time

    Job Description :- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    1 week ago

    Hyderabad, India Madhees Techno Consulting Pvt. Ltd. Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    4 days ago

    Hyderabad, India ValueLabs Full time

    Experience: 5-10 yearsLocation: Hyderabad OR IndoreJD :Proficiency in designing, implementing, and maintaining Azure Data Engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.Experience with data warehousing, ETL, and data governance. Strong understanding of data modelling, data architecture, and data...

  • Azure data engineer

    3 days ago

    Hyderabad, India ValueLabs Full time

    Experience: 5-10 yearsLocation: Hyderabad OR IndoreJD :Proficiency in designing, implementing, and maintaining Azure Data Engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure Databricks.Experience with data warehousing, ETL, and data governance. Strong understanding of data modelling, data architecture, and data...