Senior Azure Data Engineer

Azure Data Engineer

Experience: 6-12 years

Location: Bangalore/ Pune

Employment Type: Full-time

Preferred candidates should currently be serving their notice period.

Job Summary

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data solutions on Microsoft Azure. The ideal candidate will have hands-on expertise with Databricks, Azure Data Factory, PySpark, and cloud platforms including AWS, Azure, and SAP. You will be responsible for managing ETL/ELT pipelines, data modeling, integration, and processing to enable robust data-driven solutions.

Key Responsibilities

Design, implement, and optimize ELT and ETL pipelines using Azure Data Factory, Databricks, and related tools.

Develop and maintain scalable data ingestion, integration, and processing workflows using PySpark and SQL.

Build and optimize data models ensuring data integrity, quality, and accessibility.

Collaborate with data scientists, analysts, and engineering teams to deliver end-to-end data solutions.

Manage data storage layers including Azure SQL DB, Synapse, and Data Lake architectures.

Monitor, troubleshoot, and optimize data pipelines for performance and reliability.

Implement CI/CD workflows using GitHub Actions and Azure DevOps.

Use cloud services like Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube, and PyTest for analytics, orchestration, and quality checks.

Ensure security compliance and best practices in data handling and storage.

Document architecture, pipeline designs, and processes for knowledge sharing and auditing.

Mandatory Skills

Mastery of AWS, Azure, and SAP cloud platforms.

Expert in ELT techniques and data pipeline design.

Advanced skills in Data Modeling for large-scale analytics environments.

Proficient in Data Integration & Ingestion methods.

Required Skills

Hands-on experience with Azure Data Factory, Databricks, SQL DB, Synapse Analytics, Stream Analytics.

Experience with AWS Glue, Apache Airflow, AWS Kinesis, Amazon Redshift.

Familiarity with quality and testing tools such as SonarQube and PyTest.

Proficiency in GitHub, GitHub Actions, Azure DevOps for CI/CD processes.

Strong coding skills in PySpark, SQL, and Python.

Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or related field.

6 to 12 years of relevant experience in cloud data engineering roles.

Proven track record of delivering complex data pipelines and solutions on Azure and/or AWS platforms.

Job Type: Full-time

Pay: ₹1,000, ₹2,500,000.00 per year

Benefits:

• Health insurance
• Provident Fund

Ability to commute/relocate:

• Basavanagudi, Bengaluru, Karnataka: Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• May I know your current CTC ?
• If you're serving the notice period, Kindly let us know how many days remain.

Currently you're not please ignore this openings because it's some urgent requirement

Experience:

• Azure: 5 years (Required)
• SQL: 5 years (Required)
• Azure Databricks: 5 years (Required)

License/Certification:

• Azure Certification (Required)

Work Location: In person