Azure Data Engineer
4 weeks ago
Title Azure Data Engineer Location Chennai Hyderabad Bengaluru Exp 4 yrs Key Responsibilities Pipeline Development - Design build and deploy robust ETL ELT pipelines in Databricks PySpark SQL Delta Lake to ingest transform and curate governance and operational metadata from multiple sources landed in Databricks Granular Data Quality Capture - Implement profiling logic to capture issue-level metadata source table column timestamp severity rule type to support drill-down from dashboards into specific records and enable targeted remediation Governance Metrics Automation - Develop data pipelines to generate metrics for dashboards covering data quality lineage job monitoring access permissions query cost usage consumption retention lifecycle policy enforcement sensitive data mapping and governance KPIs Microsoft Purview Integration - Automate asset onboarding metadata enrichment classification tagging and lineage extraction for integration into governance reporting Data Retention Policy Enforcement - Implement logic for retention tracking and policy compliance monitoring masking RLS exceptions Job Query Monitoring - Build pipelines to track job performance SLA adherence and query costs for cost and performance optimization Metadata Storage Optimization - Maintain curated Delta tables for governance metrics structured for efficient dashboard consumption Testing Troubleshooting - Monitor pipeline execution optimize performance and resolve issues quickly Collaboration - Work closely with the lead engineer QA and reporting teams to validate metrics and resolve data quality issues Security Compliance - Ensure all pipelines meet organizational governance privacy and security standards Required Qualifications Bachelor s degree in Computer Science Engineering Information Systems or related field 4 years of hands-on data engineering experience with Azure Databricks and Azure Data Lake Proficiency in PySpark SQL and ETL ELT pipeline design Demonstrated experience building granular data quality checks and integrating governance logic into pipelines Working knowledge of Microsoft Purview for metadata management lineage capture and classification Experience with Azure Data Factory or equivalent orchestration tools Understanding of data modeling metadata structures and data cataloging concepts Strong debugging performance tuning and problem-solving skills Ability to document pipeline logic and collaborate with cross-functional teams Preferred Qualifications Microsoft certification in Azure Data Engineering Experience in governance-heavy or regulated environments e g finance healthcare hospitality Exposure to Power BI or other BI tools as a data source consumer Familiarity with DevOps CI-CD for data pipelines in Azure Experience integrating both cloud and on-premises data sources into Azure
-
Level , Carnival Infopark, Inforpark, Kakkanad Kerala, Kochi, India AZURE,CICD Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKey Responsibilities: Application Development• Design, develop, and maintain high-performance applications using .NET Core.• Collaborate with cross-functional teams to translate business requirements into technical solutions.• Develop and integrate APIs that support seamless retail operations. Cloud Architecture & Azure Solutions•...
-
Azure Data Engineer
2 weeks ago
India TCP Corps Full time ₹ 1,20,000 - ₹ 1,80,000 per yearJob Description: Senior Azure Data Engineer (8+ Years Experience) Location: Remote Salary – Up to 15 LPA Job Summary: We are seeking a highly skilled Senior Azure Data Engineer with 8+ years of experience in designing, implementing, and optimizing data solutions on Azure Cloud. The ideal candidate will have strong expertise in Azure Data Factory...
-
Azure Data Engineer
6 days ago
India Inumellas Full timePosition - Azure Data Engineer Role - Data Engineer & Senior Data Engineer Exp range - 4 Yrs to 10 Yrs Position Type - Permanent FTE Locations - Bengaluru, Chennai, Hyderabad Company - Global Leader in Data Analytics, Cloud and AI Notice Period - Serving or Immediate Joiners ONLY (Need joining in November or before 15-Dec) Skills & Experience: 5+ years of...
-
Azure Data Engineer
4 weeks ago
india Tata Consultancy Services Full timeRole - Azure Data Engineer Required Technical Skill Set Azure Data Factory + Azure Databricks. Desired Experience Range - 8 TO 12 years Location of Requirement Mumbai, Bangalore, Hyderabad, Chennai, Gurgaon, Pune.Desired Competencies (Technical/Behavioral Competency) Must-Have Azure Data Factory, Azure Databricks Good-to-Have Python/PysparkResponsibility of...
-
Azure Data Engineer
3 days ago
Chennai, India Viraaj HR Solutions Private Limited Full timeJob Description Job Title: Azure Data Engineer Industry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and...
-
Azure Data Engineer
1 week ago
India SystemBender Full time*Role: Azure Data Engineer*• Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...
-
Azure Data Engineer
3 days ago
India SystemBender Full timeJob Description *Role: Azure Data Engineer* Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage) Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) Good to have an...
-
Azure data engineer
4 days ago
India People Consultancy Services Full timePosition: Azure Data Engineer Location: Remote Duration: 12 Months Contract Shift Timing: 11:00 AM – 8:00 PM (India Time) Job Description: Looking for 5+ Years experience in Advanced SQL, Azure Data Factory (ADF), Databricks (with Py Spark). Experience with Azure Synapse (added advantage). Strong understanding of Big Data processing approaches and...
-
Azure Data Engineer
1 week ago
India SystemBender Full time*Role: Azure Data Engineer* • Advance SQL Azure Data Factory (ADF) Databricks with PySpark Azure Synapse (added advantage) • Fully conversant with big-data processing approaches and schema-on-read methodologies is a must and knowledge of Azure Data Factory / Azure Databricks (PySpark) / Azure Data Lake Storage (ADLS Gen 2) • Good to have an excellent...
-
Azure Data Engineer
1 week ago
India Hungry Hr Full time ₹ 9,00,000 - ₹ 12,00,000 per year* 4–8 yrs exp as Azure Data Engineer * Strong in Azure Databricks, Data Lake & Data Factory * Experience with Azure Synapse Analytics * Hands-on with PySpark & Python * Build & optimize scalable data pipelines * 6Months Contract & Extendable job
