Azure Data Engineer

15 hours ago

Hyderabad, India Alignity Full time

Do you love a career where you Experience, Grow & Contribute at- the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the- meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a- MS Azure with ADF/Databricks- Position- looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive- Talent Solution.

Location : Bengaluru

Exp : 5 - 8 Years

Requirements :


We are seeking a skilled Azure Data Engineer to design, develop, and optimize our data solutions on Microsoft Azure, focusing on Azure Data Factory (ADF) and Azure Databricks. This role requires an in-depth understanding of Azure cloud services, data transformation, and pipeline development, enabling the organization to leverage data for insights and decision-making.

Key Responsibilities :

Data Pipeline Development and Management :

- Design and implement scalable, reliable, and high-performance data pipelines using Azure Data Factory (ADF) to ingest, transform, and load data from various data sources.

- Develop end-to-end ETL/ELT processes within ADF, ensuring data quality, accuracy, and consistency.

- Data Transformation and Processing with Databricks

- Utilize Azure Databricks for data wrangling, cleaning, and transformations to prepare data for analytics and machine learning.

- Implement Spark-based data engineering workflows within Databricks, optimizing performance and cost efficiency.

- Collaborate with data scientists to prepare data for advanced analytics and machine learning models.

Database and Data Storage Optimization :

- Work with Azure Data Lake Storage (ADLS), SQL Databases, and other Azure storage solutions to manage data and ensure efficient access.

- Design and implement optimized data storage solutions that support the scalability and agility of data processing workflows.

Data Governance and Security :

- Implement robust data governance practices, ensuring compliance with data security, privacy policies, and data retention requirements.

- Apply access control mechanisms, data masking, and encryption strategies to protect sensitive data in ADF and Databricks.

Performance Tuning and Optimization :

- Monitor and improve the performance of ETL/ELT processes within ADF and Databricks.

- Troubleshoot and resolve issues related to data pipelines, storage, and processing, ensuring high availability and reliability.

Collaboration and Documentation :

- Collaborate with data architects, analysts, and business stakeholders to define data requirements and develop solutions that align with business goals.

- Document processes, configurations, and best practices to facilitate knowledge sharing within the team.

Required Qualifications :

- Bachelor's degree in Computer Science, Information Systems, or related field.

- 3+ years of experience in data engineering or similar role, with a focus on Microsoft Azure.

- Proficiency in Azure Data Factory for ETL/ELT processes, including activities like data ingestion, transformation, scheduling, and monitoring.

- Hands-on experience with Azure Databricks for data processing, transformation, and pipeline development using Spark.

- Strong knowledge of SQL and Python/Scala for data manipulation, scripting, and automation within Databricks.

- Familiarity with Azure Data Lake Storage (ADLS) and other Azure storage solutions.

- Experience in performance tuning and cost optimization of data workflows on cloud infrastructure.

- Knowledge of Azure DevOps for CI/CD pipeline management, version control, and workflow automation.

Preferred Qualifications :

- Azure Certifications (e.g., Microsoft Certified: Azure Data Engineer, Azure Fundamentals).

- Experience in real-time data processing using Azure Stream Analytics or Event Hub.

- Familiarity with Power BI or other visualization tools for reporting and dashboarding.

- Understanding of data governance and compliance standards (GDPR, HIPAA, etc.).

(ref:hirist.tech)

  • Data Engineer

    4 weeks ago

    Hyderabad, India NTT DATA Full time

    Job Description Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process...

  • Azure data engineer

    1 month ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    1 month ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    1 month ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 weeks ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    5 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Data Engineer

    2 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Title : Azure Data EngineerExperience : 5+ years as Azure Data EngineerLocation : HyderabadAt our company, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by...

  • Azure Data Engineer

    6 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    5 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 months ago

    Hyderabad, India ProArch Full time

    ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven...

  • Azure Data Engineer

    1 month ago

    Hyderabad, Telangana, India Madhees Techno Full time

    Job Description :- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    1 month ago

    Hyderabad, India Madhees Techno Full time

    Job Description :- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Data Engineer

    2 months ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Azure data engineer

    2 weeks ago

    Hyderabad, India Algoleap Full time

    About the Company : Algoleap is a digital product engineering firm that is centered around a cloud first, agile first mindset to deliver next gen technology efficiencies and impact with modern apps build out and management. Our service offerings span product engineering with bespoke apps and data/AI PODs, enterprise apps, automation & AI and service...

  • Azure Data Engineer

    2 weeks ago

    hyderabad, India algoleap Full time

    About the Company : Algoleap is a digital product engineering firm that is centered around a cloud first, agile first mindset to deliver next gen technology efficiencies and impact with modern apps build out and management. Our service offerings span product engineering with bespoke apps and data/AI PODs, enterprise apps, automation & AI and service...

  • Azure Data Engineer

    1 week ago

    Hyderabad, India Ray Business Technologies (A CMMI Level 3 Company) Full time

    JD - Azure Data Engineer (URGENT HIRING)Role Description:This is a full-time remote role for a Data Engineer. The Data Engineer will be responsible for designing, implementing, and maintaining the data architecture while ensuring optimal data delivery architecture is consistent throughout ongoing projects. Expected expertise for this role is in Azure Cloud,...