Azure Data Engineer
11 hours ago
Azure Data Engineer (Senior) with skills Data Engineering, Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery for location Gurugram, India Posted on: November 12, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Key Responsibilities Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activities. Technical Skills Core: Python, PySpark, SQL Databricks: Delta Lake, Unity Catalog, Databricks Workflows, MLflow (basic understanding) GCP: Dataproc, BigQuery, GCS, Composer/Airflow, Cloud Functions Data Engineering: Hadoop, Hive, Pig, Spark SQL Automation: Experience with migration utilities or AI-assisted code transformation tools CI/CD: Git, Jenkins, Terraform (preferred) Validation: Data comparison utilities (Delta-to-Delta, DataFrame diffing, schema validation) Preferred Experience 5–8 years in data engineering or big data application development. Hands-on experience migrating Spark or Hadoop workloads to Databricks. Familiarity with Delta architecture , data quality frameworks , and GCP cloud integration . Exposure to GenAI-based tools for automation or code refactoring is a plus. EXPERIENCE 6-8 Years SKILLS Primary Skill: Data Engineering Sub Skill(s): Data Engineering Additional Skill(s): Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery ABOUT THE COMPANY Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP). Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.
-
Azure Data Engineer
11 hours ago
Gurugram, India Epergne Solutions Full timeJob Title : Azure Data Engineer Location : Remote Experience : 5 +Years Notice Period : 15 Days / Immediate Only Primary Responsibilities: Design, develop, and maintain data storage solutions using Azure SQL Database , Azure Data Lake , and Azure Blob Storage . Build and manage data pipelines for ingestion, processing, and transformation within Azure. Create...
-
Azure Data Engineer
3 weeks ago
Gurugram, India Skillkart Consultancy Full timeDescription :Key Responsibilities :- Design and build secure, scalable, and reliable data pipelines using Azure Data Factory, Synapse Analytics, and other Azure services.- Develop ETL/ELT processes to ingest data from multiple sources including APIs, databases, and flat files.- Work with structured and unstructured data to support analytics, data science,...
-
Azure Data Engineer
12 hours ago
Gurugram, India Absolutdata Full timeLocation : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development etc. Proficient...
-
Data Engineer
4 weeks ago
Gurugram, India SkillKart Full timeDescription :Role Overview :We are seeking a skilled Data Engineer with expertise in Microsoft Azure to join our Data & Analytics team. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and architectures using Azure data services. You will collaborate with cross-functional teams including data scientists,...
-
Data Engineer
1 week ago
Gurugram, India One Degree North HR Services Full timeJob Description : Function : Data Science and Analysis ? Data Analysis / Business Intelligence, Software Engineering ? Big Data / DWH / ETLDatabricks Data AnalysisETL+5 more Data Warehousing Spark SQLAzure Data Factory Azure SynapseRequirements : - 5 years of experience in data engineering, with at least 3+ years in Azure Databricks.- Strong proficiency in...
-
Azure Data Engineer
3 weeks ago
Gurugram, India ACENET CONSULTING PRIVATE LIMITED Full timeDescription :About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer...
-
Data Engineer
4 weeks ago
Gurugram, India Ixceed Solutions Full timeJob Description : We are seeking a skilled Data Engineer with strong expertise in Azure data services to design and implement effective data solutions, support data quality, and contribute to cloud migration strategies. This role is key in building scalable data pipelines, maintaining data integrity, and collaborating on data architecture best practices...
-
EXL - Data Engineer - Azure Data Services
1 week ago
Gurugram, India EXL Full timeRole Summary : We are looking for a skilled Data Engineer with solid experience in the Azure data ecosystem and hands-on expertise in Azure Databricks. The ideal candidate will have worked on designing and developing scalable, cloud-native data pipelines and solutions using Azure data services. You will contribute to building and optimizing data lakehouse...
-
Azure Data Engineer
3 days ago
Gurugram, India AceNet Full timeDescription :Job Summary :We are seeking experienced and technically proficient Azure Data Engineers to join our team. You should be well versed in coding, spark core and data ingestion using Azure. Experience with core Azure DE skills and coding skills (pyspark, python and SQL).Key Responsibilities :- Create and maintain data storage solutions including...
-
Data Engineer
3 weeks ago
Gurugram, India Ixceed Solutions Full timeDescription :- Integrating data from various sources into a unified Azure data warehouse and suitable data marts.- Continuously monitoring and testing the availability, performance and quality of data pipelines.- Collaborating with peers by employing and following SDLC best practice while maintaining code repositories and activity using Agile, DevOps and...