Azure Data Engineer

2 days ago

Gurgaon, Haryana, India Infogain Full time ₹ 8,00,000 - ₹ 12,00,000 per year

ROLES & RESPONSIBILITIES

Key Responsibilities

  • Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark.
  • Implement data ingestion and transformation pipelines using Delta Lake best practices.
  • Apply conversion rules and templates for automated code migration and testing.
  • Conduct data validation between legacy and migrated environments (schema, count, and data-level checks).
  • Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation.
  • Ensure best practices for code versioning, error handling, and performance optimization.
  • Participate in UAT, troubleshooting, and post-migration validation activities.

Technical Skills

  • Core: Python, PySpark, SQL
  • Databricks: Delta Lake, Unity Catalog, Databricks Workflows, MLflow (basic understanding)
  • GCP: Dataproc, BigQuery, GCS, Composer/Airflow, Cloud Functions
  • Data Engineering: Hadoop, Hive, Pig, Spark SQL
  • Automation: Experience with migration utilities or AI-assisted code transformation tools
  • CI/CD: Git, Jenkins, Terraform (preferred)
  • Validation: Data comparison utilities (Delta-to-Delta, DataFrame diffing, schema validation)

Preferred Experience

  • 5–8 years in data engineering or big data application development.
  • Hands-on experience migrating Spark or Hadoop workloads to Databricks.
  • Familiarity with Delta architecture, data quality frameworks, and GCP cloud integration.
  • Exposure to GenAI-based tools for automation or code refactoring is a plus.

EXPERIENCE

6-8 Years

SKILLS

Primary Skill: Data Engineering

Sub Skill(s): Data Engineering

Additional Skill(s): Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery

ABOUT THE COMPANY

Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune 500 companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP).

Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.

  • Data Engineer

    1 week ago

    Gurgaon, Haryana, India CoPoint Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Engineer Location: India (Gurugram)About CoPointAIAI isn't coming — it's here. And we help enterprises make it real. At CoPointAI, we work inside the enterprise — not just around it — to turn AI potential into practical wins. From hands-on C-suite workshops (our AI Foundations series) to AI-native MVPs built in weeks, our team partners...

  • Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India ixceed Full time ₹ 6,03,000 - ₹ 20,04,459 per year

    Role: Azure Data EngineerLocation: Gurugram, HaryanaMode: HybridType: ContractJob Description:EXPERIENCE:· 6+ years of total experience in the IT industry as a developer/senior developer/data engineer· 4+ years of experience of working extensively with Azure services such as Azure Data Factory, Azure Synapse, and Azure Datalake· 3+ years of experience...

  • Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Fiftyfive technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About the Role:We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Azure Data Services, particularly Azure Databricks. The ideal candidate will be responsible for building robust, scalable, and high-performance data solutions to support business analytics and insights. Databricks certification is highly preferred.Key...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India crescendo global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description Azure Data Engineer - 3 Years - Gurgaon Location: IndiaDiscipline: AnalyticsJob type: PermanentContact name: Aayushi GoyalContact email: Job ref: 82793Published: about 9 hours ago Azure Data Engineer 3 Years Gurgaon An excellent opportunity to join a leading global analytics organization where innovation meets impact. This role is perfect...

  • Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Imbibe Consultancy Services Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience:5 to 8 yearsLocation:Bengaluru, Gurgaon, PuneJob code:101213Posted on:May 07, 2025About UsAceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across...

  • Azure Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSTCS is hiring forAzure Data Engineer (Data Bricks Engineer)Job location:Bangalore / Pune / Chennai / Hyderabad / GurgaonDesired Experience Range:5 to 10 YearsJob Description:Strong experience in Azure Data Factory , ADB( Azure Databricks) Synapse, pyspark; establishing the cloud connectivity between different system like ADLS, ADF, Synapse,...

  • Lead Azure Data Engineer

    2 days ago

    Gurgaon, Haryana, India Naukri Healthcare Jobs Full time ₹ 1,50,00,000 - ₹ 3,00,00,000 per year

    We are looking for a skilled Lead Azure Data Engineer with 8 to 15 years of experience in the Pharmaceutical & Life Sciences industry, specifically at Syneos Health. The ideal candidate will have expertise in designing and implementing data pipelines using Azure.Roles and ResponsibilityDesign and implement scalable data pipelines using Azure.Collaborate with...

  • Senior Azure Data Engineer

    1 week ago

    Gurgaon, Haryana, India Teleperformance (TP) Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesSenior Azure Data Engineer (Microsoft Azure Data Bricks Certificate and BPO Background mandatory)zure SQL Experience:Azure SQL Database or serverDatabase design and optimizationQuery optimizationData transformation processesData management in AzureAzure Data Factory Expertise:Azure Data Factory (ADF)ETL pipelinesData...

  • Azure Data Architect

    1 week ago

    Gurgaon, Haryana, India Multicloud4U® Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Azure Data ArchitectExperience: 8 to 15 YearsLocation: GurugramSkills: Azure Data FactorySQLOracleWe are seeking a highly experienced Azure Data Architect with deep expertise in designing and implementing end-to-end data solutions on the Microsoft Azure platform. The ideal candidate will have a strong background in SQL Server, SSIS, Azure...

  • Azure Data Engineer

    6 days ago

    Gurgaon, Haryana, India WNS Global Services Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Assistant Manager-Azure Data Engineer Company Description WNS (Holdings) Limited (NYSE: WNS), is a leading Business Process Management (BPM) company. We combine our deep industry knowledge with technology and analytics expertise to co-create innovative, digital-led transformational solutions with clients across 10 industries. We enable businesses in...