Azure Data Engineer

5 days ago

Hyderabad, India HireIT Consultants Full time

Job Title : Azure Data Engineer

Job Type : Full-time / Contract

Experience : 5+ Years

About the Role :

We are seeking a skilled Azure Data Engineer with hands-on experience in Azure Data Factory (ADF), Power BI, Azure Synapse Analytics, and PySpark to join our growing data engineering team. The ideal candidate will have a strong background in cloud-based data engineering, data transformation, and data visualization, with a passion for building scalable and efficient data pipelines.

As an Azure Data Engineer, you will be responsible for developing and managing data integration workflows, designing and optimizing data models, and ensuring the successful delivery of data solutions. You will collaborate with data scientists, business analysts, and other stakeholders to create end-to-end data solutions that support analytics, reporting, and business intelligence.

Key Responsibilities :

- Design, implement, and maintain data pipelines using Azure Data Factory (ADF) to move and transform data across various sources and destinations.

- Leverage Azure Synapse Analytics for building and optimizing data warehousing solutions, and implement real-time and batch data processing strategies.

- Develop data models, structures, and workflows using PySpark for large-scale data processing and analytics.

- Create interactive Power BI reports and dashboards for data visualization and business insights.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications for data solutions.

- Ensure data quality, integrity, and security across all stages of the data pipeline.

- Optimize and tune data pipeline performance, monitor data pipeline jobs, and troubleshoot issues.

- Implement best practices for data engineering processes, including data governance, scalability, and automation.

- Provide technical leadership and guidance on Azure Data Engineering technologies to junior engineers and other team members.

Required Skills and Qualifications :

- 5+ years of experience as a Data Engineer or in a related role.

- Strong expertise in Azure Data Factory (ADF), with hands-on experience in designing and orchestrating data pipelines.

- Proven experience with Azure Synapse Analytics, including data warehousing, analytics, and integration with other Azure services.

- Proficiency in PySpark for distributed data processing and building scalable data processing solutions.

- Hands-on experience with Power BI for building interactive reports and dashboards for data-driven insights.

- Strong SQL skills and experience with data modeling, transformations, and querying large datasets.

- Solid understanding of ETL processes, data integration, and data governance.

- Familiarity with Azure services like Azure Blob Storage, Azure SQL Database, Azure Data Lake, and Azure Databricks is a plus.

- Experience with data version control, deployment, and automation tools.

- Excellent problem-solving skills and the ability to troubleshoot complex data pipeline issues.

- Strong communication skills with the ability to work effectively with both technical and non-technical teams.

Preferred Qualifications :

- Experience with Azure Databricks and Spark clusters for big data processing.

- Familiarity with Azure Machine Learning or other advanced analytics tools.

- Knowledge of DevOps practices and CI/CD pipelines for automating data pipeline deployments.

- Experience with agile methodologies and working in agile teams.

(ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Hyderabad, India NTT DATA Full time

    Job Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...

  • Azure data engineer

    4 weeks ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    4 weeks ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    6 days ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 week ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 week ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Title: Azure Data EngineerAt Madhees Techno, we are seeking a highly skilled Azure Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing data storage systems that scale, perform, and are economical enough to satisfy our organization's requirements.Key Responsibilities:Design...

  • Azure Data Engineer

    5 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    5 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    5 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    5 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team at Vidpro Consultancy Services. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Azure.Key Responsibilities:Design and implement data pipelines using Azure Data...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on Microsoft Azure.Key Responsibilities:Design and implement data ingestion pipelines using Azure...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Enviri Corporation Full time

    {"title": "Azure Data Engineer", "description": "Job SummaryWe are seeking an experienced Azure Data Engineer to join our team at Enviri Corporation. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines and architectures on the Azure platform.Key ResponsibilitiesDesign and...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Clean Harbors Full time

    Job Title: Azure Data EngineerAt Clean Harbors, we are seeking a skilled Azure Data Engineer to join our team. The ideal candidate will have a strong background in designing, implementing, and managing data solutions on the Microsoft Azure cloud platform.Key Responsibilities:Design and implement scalable data storage systems that meet the organization's...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Anblicks Full time

    Azure Data Engineer RoleWe are seeking a highly skilled Azure Data Engineer to join our team at Anblicks. As a key member of our data engineering team, you will be responsible for designing, building, and implementing robust data pipelines using the Microsoft Stack.Key ResponsibilitiesDesign and implement data pipelines using Azure Data Factory, Azure Data...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job Title: Azure Data EngineerWe are seeking a highly skilled Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data processing systems on Microsoft Azure.Key Responsibilities:Design and implement scalable data ingestion pipelines using...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India 2coms Full time

    Job DescriptionJob Title: Azure Data EngineerJob Summary:We are seeking an experienced Azure Data Engineer to join our team at 2coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using Azure technologies.Key Responsibilities:Design and implement data...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India ProArch Full time

    ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven...