Azure Data Engineer

3 days ago

Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Description : Azure Data Engineer

Experience: 6-12 years

Location: Bangalore \ Pune - Hybrid Mode

Employment Type: Full-time

Job Summary

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise with Databricks, Azure Data Factory, PySpark, and cloud platforms including AWS, Azure, and SAP. You will be responsible for managing ETL/ELT pipelines, data modeling, integration, and processing to enable robust data-driven solutions.

Key Responsibilities

Design, implement, and optimize ELT and ETL pipelines using Azure Data Factory, Databricks, and related tools.

Develop and maintain scalable data ingestion, integration, and processing workflows using PySpark and SQL.

Build and optimize data models ensuring data integrity, quality, and accessibility.

Collaborate with data scientists, analysts, and engineering teams to deliver end-to-end data solutions.

Manage data storage layers including Azure SQL DB, Synapse, and Data Lake architectures.

Monitor, troubleshoot, and optimize data pipelines for performance and reliability.

Implement CI/CD workflows using GitHub Actions and Azure DevOps.

Use cloud services like Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, and PyTest for analytics, orchestration, and quality checks.

Ensure security compliance and best practices in data handling and storage.

Document architecture, pipeline designs, and processes for knowledge sharing and auditing.

Mandatory Skills

Mastery of AWS, Azure, and SAP cloud platforms.

Expert in ELT techniques and data pipeline design.

Advanced skills in Data Modeling for large-scale analytics environments.

Proficient in Data Integration & Ingestion methods.

Required Skills

Hands-on experience with Azure Data Factory, Databricks, SQL DB, Synapse Analytics, Stream Analytics.

Experience with AWS Glue, Apache Airflow, AWS Kinesis, Amazon Redshift.

Familiarity with quality and testing tools such as SonarQube and PyTest.

Proficiency in GitHub, GitHub Actions, Azure DevOps for CI/CD processes.

Strong coding skills in PySpark, SQL, and Python.

Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field.

6 to 12 years of relevant experience in cloud data engineering roles.

Proven track record of delivering complex data pipelines and solutions on Azure and/or AWS platforms.

azureengineer #SAP #sql #pyspark #datapipeline #python #ADF #azuredevops #immediatejoiner #hybrid #bangalorelocation #punelocation

  • Senior Azure Data Engineer

    1 day ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ERP Senior Specialist Job Title: Azure Senior Data Engineer We are looking a highly skilled and experienced Senior Azure Data Engineer to join our team. This role requires deep expertise in Azure Data Factory and Databricks, including CI/CD setup for Databricks, and strong proficiency in ETL, SQL, and modern data engineering practices. You will be the...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Global consulting firm seeking an Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing and implementing robust data pipelines and workflows using Azure cloud technologies. The ideal candidate will possess a deep understanding of data engineering principles and hands-on experience with Azure data...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Azure Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Max Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    REQUIRED SKILLS:Bachelor's degree in Computer Science, Engineering, or a related field. Advanced degree preferred.Proven 6-8 years experience in designing, implementing solutions on the Azure ecosystem including expertise in Azure services such as Azure Data Factory, Azure Databricks, Azure Machine Learning, Azure Data Lake Storage, and Azure SQL Database,...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    We are looking for an experienced Azure Data Engineer - Senior Consultant .This role requires expertise in designing, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL processes, and the Azure ecosystem.Experience: 7 to 8 years Location: Bangalore RequirementsKey...

  • Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Aionos Full time ₹ 20,00,000 - ₹ 60,00,000 per year

    We are seeking a highly skilled Senior Data Engineer with 12+ years of experience in data engineering and 8+ years of hands-on expertise in Azure technologies. The ideal candidate will have strong skills in ELT, data modeling, integration, and Kubernetes, along with experience in Azure Data Factory and Databricks. This role requires strong technical...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Wenger & Watson Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Azure ADF, Databricks with Pyspark/ PythonData Engineer with Pyspark, Databricks skillset 4+ years of experience Data Engineering with min 3+ years hands on experience in Pyspark for data transformationsSound Knowledge on - Azure Data Bricks, Azure Data Lake.Sound knowledge in Data Bricks & Logic AppsDelta Lake, Azure SQL and Azure blob storage, Azure logic...

  • Machine Learning Engineer with Azure Databricks

    1 week ago

    Bengaluru, Karnataka, India Enable Data Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Design, implement, and maintain data infrastructure to process and store large-scale vision data setsBuild automated workflows for data ingestion, transformation, and validation within the Azure ML ecosystemDevelop monitoring systems and data quality controls for AML pipeline operationsCreate and maintain data asset management strategies within Azure ML...

  • Azure Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Changeleaders Consulting Full time ₹ 10,000 - ₹ 60,000 per year

    Well versed in Azure Data Engineering: Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, Databricks, SQL Database etc.Hands-on experience in programming languages like Python/Pyspark and SQL

  • Azure Data Engineer

    6 days ago

    Bengaluru, Karnataka, India Meritude Skill Development Full time ₹ 6,00,000 - ₹ 9,00,000 per year

    Candidate should have experience in 80% in azure data and 20% in azure devops CI/CD Maintain and monitor Data bricks-based data pipelines and Azure data services. Implement CI/CD pipelines using Azure DevOps for data engineering workflows.