Azure Data Engineer

5 days ago

Hyderabad, Telangana, India IT Service Company Full time

Job Description :

- The ideal candidate should be able to work in Client delivery center during EMEA hours.

- Hands on years of experience as an Azure Data Engineering, Azure Databricks and Pyspark.

- Experience developing complex data pipelines on Azure.

- Experience migrating data from on-prem and cloud based systems to Azure.

- Experience with dimensional data models and data warehouses.

- Proficient in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake, and Azure SQL Database.

- Strong programming skills in Python, SQL, and Scala (optional).

- Experience with data modeling, ETL/ELT processes, and big data frameworks (e. , Spark).

- Familiarity with Azure DevOps, Git, and CI/CD pipeline implementation.

- Knowledge of Azure security practices, including AAD, Key Vault, and RBAC.

About the Role :

We are seeking a highly motivated and experienced Azure Data Engineer to join our Client Delivery Center and work during EMEA hours. This role requires a hands-on individual with deep expertise in Azure data engineering services, particularly Azure Databricks, and PySpark. You will be responsible for designing, building, and maintaining complex data pipelines on Azure, migrating data from various sources, and ensuring the performance and security of our data platform.

This position requires excellent communication skills and the ability to collaborate effectively with clients and internal teams.

Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain complex data pipelines using Azure Data Factory, Azure Databricks, and PySpark.

Data Migration :

- Migrate data from on-premises and cloud-based systems to Azure, ensuring data integrity and minimal downtime.

Data Modeling :

- Implement dimensional data models and data warehouses on Azure Synapse Analytics and Azure SQL Database.

ETL/ELT Processes :

- Develop and optimize ETL/ELT processes for data ingestion, transformation, and loading.

Big Data Processing :

- Utilize big data frameworks like Spark for processing large datasets efficiently.

Azure Service Expertise :

- Demonstrate proficiency in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage Gen2, and Azure SQL Database.

Programming Skills :

- Utilize strong programming skills in Python (essential), SQL (essential), and Scala (optional) for data manipulation and processing.

DevOps Practices :

- Implement CI/CD pipelines using Azure DevOps and Git for automated build, testing, and deployment.

Security :

- Adhere to Azure security best practices, including Azure Active Directory (AAD), Azure Key Vault, and Role-Based Access Control (RBAC).

Performance Optimization :

- Monitor and optimize data pipeline performance to meet business requirements and SLAs.

Collaboration :

- Work closely with clients and internal teams to gather requirements, provide updates, and ensure successful project :

- Create and maintain clear and comprehensive documentation for data pipelines and other data engineering processes.

Requirements :

Experience :

- Hands-on experience as an Azure Data Engineer, with a focus on Azure Databricks and PySpark. (Specify number of years of experience desired, e.g., 5+ years).

Technical Skills :

- Strong proficiency in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage Gen2, and Azure SQL Database.

- Excellent programming skills in Python and SQL. Scala experience is a plus.

- Experience with data modeling, ETL/ELT processes, and big data frameworks (e.g., Spark).

- Familiarity with Azure DevOps, Git, and CI/CD pipeline implementation.

- Knowledge of Azure security practices, including AAD, Key Vault, and RBAC.

Data Warehousing :

- Experience with dimensional data models and data warehouse design. Data Migration:

- Experience migrating data from on-premises and cloud-based systems to Azure.

Communication Skills :

- Excellent verbal and written communication skills in English.

Client-Facing Skills :

- Ability to interact effectively with clients and understand their needs.

Availability :

- Must be available to work during EMEA business hours.

Education :

- Bachelor's degree in Computer Science, Engineering, or a related field preferred.

Bonus Points :

- Experience with other Azure data services (e.g., Azure Cosmos DB, Azure Stream Analytics). Knowledge of data governance and data quality practices.

- Experience with Agile methodologies.

Certifications :

Microsoft Certified :

- Azure Data Engineer Associate or similar.

(ref:hirist.tech)

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Coforge Full time

    Role: Azure Data Engineer Skills: Databricks, PySpark & Python Experience: 5 - 10 years Locations: Hyderabad, Bengaluru & Pune We at Coforge are hiring Azure Data Engineers with the following skillset: Experience & Education: Bachelor's degree in Computer Science, Computer Engineering, Information Systems (CIS/MIS), Technology, Engineering, or a related...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Coforge Full time

    Role: Azure Data EngineerSkills: Databricks, PySpark & PythonExperience: 5 - 10 yearsLocations: Hyderabad, Bengaluru & PuneWe at Coforge are hiring Azure Data Engineers with the following skillset:Experience & Education:Bachelor's degree in Computer Science, Computer Engineering, Information Systems (CIS/MIS), Technology, Engineering, or a related technical...

  • Azure Data Engineer

    1 day ago

    Hyderabad, Telangana, India Nazztec Private Limited Full time

    Job Title : Azure Data Engineer Location : Hyderabad (Hybrid) Experience : 8 years Job Description : We are seeking a highly skilled Azure Data Engineer with expertise in ADF (Azure Data Factory), SQL, ABD (Azure Databricks - UC Delta Tables), PySpark, Python, and Synapse Analytics. The ideal candidate will be responsible for designing, implementing, and...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India TalentOla Full time

    Job Description Work closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisions Implement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream...

  • Azure Data Engineer

    6 days ago

    Hyderabad, Telangana, India TalentOla Full time

    Job Summary We are seeking a highly skilled Data Engineer to work closely with our source data application teams and product owners to design, implement and support analytics solutions that provide valuable insights for informed decision making. The ideal candidate will have experience in implementing data migration and data engineering solutions using Azure...

  • Azure Data Engineer

    5 days ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    Job Description : We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team. The ideal candidate will have a strong background in building and maintaining data pipelines and working with large datasets on the Azure cloud platform. The Azure Data Engineer will be responsible for developing and implementing efficient...

  • Azure Data Engineer

    24 hours ago

    Hyderabad, Telangana, India TalentOla Full time

    Job DescriptionWork closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisionsImplement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India N Human Resources & Management Systems Full time

    Job Description Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, Data Orchestration, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestration , real time data processing experience and frameworks, Azure cloud experience Role: Advanced Data Engineer , Job DescriptionMinimum  3  years of experience in Data...

  • Azure Data Engineer

    6 days ago

    Hyderabad, Telangana, India 3K SOFTECH PRIVATE LIMITED Full time

    Technical Skills :- Azure Data Services : In-depth experience with Azure Data Factory, Azure Databricks, and other Azure data solutions like Azure Synapse, Azure Blob Storage, Azure SQL Database, etc.- Big Data Technologies : Strong proficiency in Apache Spark and PySpark for processing large datasets, with hands-on experience in optimizing Spark jobs.-...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India HireIT Consultants Full time

    Job Description :We are seeking a skilled and dynamic Azure Data Engineer to join our growing data engineering team. The ideal candidate will have a strong background in building and maintaining data pipelines and working with large datasets on the Azure cloud platform. The Azure Data Engineer will be responsible for developing and implementing efficient ETL...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India TalentOla Full time

    Job DescriptionWork closely with source data application teams and product owners to design, implement and support analytics solutions that provide insights to make better decisionsImplement data migration and data engineering solutions using Azure products and services: (Azure Data Lake Storage, Azure Data Factory, Azure Functions, Event Hub, Azure Stream...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Nazztec Private Limited Full time

    Job Title : Azure Data EngineerLocation : Hyderabad (Hybrid)Experience : 8+ yearsJob Description :We are seeking a highly skilled Azure Data Engineer with expertise in ADF (Azure Data Factory), SQL, ABD (Azure Databricks - UC + Delta Tables), PySpark, Python, and Synapse Analytics. The ideal candidate will be responsible for designing, implementing, and...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India Nazztec Private Limited Full time

    Job Title : Azure Data EngineerLocation : Hyderabad (Hybrid)Experience : 8+ yearsJob Description :We are seeking a highly skilled Azure Data Engineer with expertise in ADF (Azure Data Factory), SQL, ABD (Azure Databricks - UC + Delta Tables), PySpark, Python, and Synapse Analytics. The ideal candidate will be responsible for designing, implementing, and...

  • Azure Data Engineer

    5 days ago

    Hyderabad, Telangana, India Nazztec Private Limited Full time

    Job Title : Azure Data Engineer Location : Hyderabad (Hybrid) Total Experience : 8 years Job Description : We are seeking a highly skilled and experienced Azure Data Engineer to join our dynamic team in Hyderabad. This is a hybrid role, offering flexibility with a combination of remote and on-site work. The ideal candidate will have extensive experience...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Greetings from TCS**TCS is Hiring for Azure Data Engineer **Walk-in Interview for Azure Databricks Data Engineer in HyderabadWalk-in Interview Date: 8th March 2025 (Saturday)Role: Azure Data EngineerDesired Experience: 4- 10 YearsJob Location: PAN INDIAJob Description:· Implementation, and operations of OLTP, OLAP, DW technologies such as Azure SQL, Azure...

  • Azure Data engineer

    24 hours ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Inviting application for Azure Data engineer roleExperience: 5+ yearsLocation: Bangalore, Bhubaneswar, Hyderabad, KolkataJob description:Role : Azure Data EngineerRequired Technical Skill Set: Azure Data Factory, Azure Data Bricks, Azure Streaming Analytics, Azure data lake, pyspark or python, etcDesired Competencies (Technical/Behavioral Competency)· 3+...

  • Azure Data Engineer

    2 days ago

    Hyderabad, Telangana, India ValueLabs Full time

    Experience: 5-10 years Location: Hyderabad OR Indore JD : Keyskills: Azure Data Services-Azure data factory, Fabric, Synapse, Data Pipelines, PowerbI Proficiency in designing, implementing, and maintaining Azure Data Engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Experience with data warehousing, ETL, and data...

  • Azure data engineer

    3 weeks ago

    Hyderabad, Telangana, India S P A Enterprise Full time

    Hi, Below is the JD for Azure Data Engineer role. Please go through it and do let me know if you are interested. Role: Azure DE Location: Remote Primary Responsibilities: Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Design, implement, and maintain data pipelines for data ingestion,...

  • Azure Data engineer

    3 weeks ago

    Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job Role : Azure Data Engineer. Job Locations : Pune , Bangalore or Hyderabad. Required Experience : 5 7 Years. Skills : Azure, Azure ADF , Databricks, Azure Synapse, Python , Pyspark. Roles And Responsibilities :- You are detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness, and business...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, Telangana, India N Human Resources & Management Systems Full time

    Proficiency In Python, SQL, Databricks, Snowflake Data Modelling, Data Orchestration, ETL Process, Apache Spark, Pyspark, Data Integration and workflow orchestration , real time data processing experience and frameworks, Azure cloud experience Role: Advanced Data Engineer , Job DescriptionMinimum  3  years of experience in Data Engineering role that...