Azure Data Engineer

5 days ago

Gurgaon, Haryana, India Metaphor Infotech Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Azure Data Engineer- Immediate joiners only

Please find the JD below for the same :

We are looking for an experienced Data Engineer to drive the development of scalable, secure, and high-performance data solutions. This role requires deep technical expertise in Python, Apache Spark, Delta Lake, and orchestration tools like Databricks Workflows or Azure Data Factory. The ideal candidate will also bring a strong understanding of data governance, metadata management, and regulatory compliance in the insurance and financial services domains. Proficient in developing Python Applications, Spark-based workflows, leveraging Delta Lake, and orchestrating jobs using Databricks Workflows or Azure Data Factory. Good to understand retention metadata, business rules, and data governance policies into reusable pipelines. Strong understanding of data privacy, security, and regulatory needs in insurance and financial domains.

Key Responsibilities:

  • Develop robust data pipelines and ETL workflows using Python and Apache Spark.

  • Orchestrate complex workflows using Databricks Workflows or Azure Data Factory.

  • Translate business rules, retention metadata, and data governance policies into reusable, modular, and scalable pipeline components.

  • Ensure adherence to data privacy, security, and compliance standards (e.g., GDPR, HIPAA, etc.).

  • Collaborate with cross-functional teams including data architects, analysts, and business stakeholders to align data solutions with business goals.

Required Skills & Qualifications:

  • 5+ years of experience in data engineering

  • Expert-level proficiency in Python, Apache Spark, and Delta Lake.

  • Strong experience with Databricks Workflows and/or Azure Data Factory.

  • Deep understanding of data governance, metadata management, and business rule integration.

  • Strong communication skills.

  • Experience with cloud platforms such as Azure.

Preferred Qualifications:

  • Experience with CI/CD pipelines and DevOps practices in data engineering.

  • Familiarity with data cataloging and data quality tools.

  • Certifications in Azure Data Engineering or related technologies.

  • Exposure to enterprise data architecture and modern data stack tools.

  • Lead Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Naukri Healthcare Jobs Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    We are looking for a skilled Lead Azure Data Engineer with 8 to 15 years of experience in the Pharmaceutical & Life Sciences industry, specifically at Syneos Health. The ideal candidate will have expertise in designing and implementing data pipelines using Azure.Roles and ResponsibilityDesign and implement scalable data pipelines using Azure.Collaborate with...

  • Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Infogain Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    ROLES & RESPONSIBILITIESKey ResponsibilitiesAnalyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark.Implement data ingestion and transformation pipelines using Delta Lake best practices.Apply conversion rules and templates for automated code migration and testing.Conduct data validation between legacy...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India WNS Global Services Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Assistant Manager-Azure Data Engineer Company Description WNS (Holdings) Limited (NYSE: WNS), is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industries. We enable businesses in...

  • Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Infogain Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ROLES & RESPONSIBILITIESKey ResponsibilitiesLead design and execution of Dataproc ? Databricks PySpark migration roadmap.Define modernization strategy, including data ingestion, transformation, orchestration, and governance.Architect scalable Delta Lake and Unity Catalog–based solutions.Manage and guide teams on code conversion, dependency mapping, and...

  • Azure Data Engineer

    2 days ago

    Gurgaon, Haryana, India INADEV Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    Essential Duties and ResponsibilitiesMinimum 3 years of experience working with Azure servicesExperience with Azure SQL Databases, Azure Data Factory, Azure Synapse, Azure Logic Apps, Azure Service Bus and Storage Accounts/Data Lake Gen 23+ years of experience working in an Azure CI/CD environmentDeep understanding of ADF parameterization and movement of...

  • Azure Data Engineering Architect

    2 weeks ago

    Gurgaon, Haryana, India Insight Enterprises Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Architect I Requisition Number: 101629 Architect I – Azure Data Engineering (Microsoft Fabric)Location: The role will be a hybrid position for Delhi NCR, Bangalore, Hyderabad, Pune, Mumbai. Insight at a Glance14,000 engaged teammates globally #20 on Fortune's World's Best Workplaces list $9.2 billion in revenue Received 35 industry and...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Antal TECH jobs Full time ₹ 1,00,00,000 - ₹ 3,00,00,000 per year

    We are seeking an experienced Data Developer with expertise in Microsoft Fabric, Azure Synapse Analytics, Databricks, and strong SQL development skills. The ideal candidate will work on end-to-end data solutions supporting analytics initiatives across clinical, regulatory, and commercial domains in the Life Sciences industry.Key Responsibilities:• Design,...

  • Senior Data Engineer

    4 days ago

    Gurgaon, Haryana, India Pacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data EngineerLocation: RemoteJob Type: Full-timeShift time: Open to work in EST shift (5PM to 2AM IST)Key ResponsibilitiesLead the design, development, and implementation of complex data integration solutions using Informatica Intelligent Data Management Cloud (IDMC).Develop, document, unit test, and maintain high-quality ETL applications that...

  • IndiGo - Lead Data Scientist - Azure Platform

    2 weeks ago

    Gurgaon, Haryana, India IndiGo (InterGlobe Aviation Ltd) Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Description : Job Summary : - Lead customer analytics and personalization initiatives using Azure AI services and large-scale customer data platforms. Key Responsibilities : - Design and deploy machine learning models using Azure Machine Learning for customer segmentation, churn prediction, lifetime value estimation, and recommendation systems. ...

  • Data Engineer

    4 days ago

    Gurgaon, Haryana, India Senpiper PTY LTD Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the RoleWe are looking for a Data Engineer with strong hands-on expertise in Databricks and the Azure Data ecosystem. This role focuses on building and optimizing large-scale data pipelines, troubleshooting performance issues, and ensuring high data quality and governance across our cloud data platforms.Key ResponsibilitiesDesign, develop, and optimize...