Azure Data Engineer
11 hours ago
Azure Data Engineer (Lead) with skills Data Engineering, Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery for location Gurugram, India Posted on: November 12, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Key Responsibilities Lead design and execution of Dataproc ? Databricks PySpark migration roadmap. Define modernization strategy , including data ingestion, transformation, orchestration, and governance. Architect scalable Delta Lake and Unity Catalog –based solutions. Manage and guide teams on code conversion, dependency mapping, and data validation. Collaborate with platform, infra, and DevOps teams to optimize compute costs and performance. Own the automation & GenAI acceleration layer , integrating code parsers, lineage tools, and validation utilities. Conduct performance benchmarking, cost optimization, and platform tuning (Photon, Auto-scaling, Delta Caching). Mentor senior and mid-level developers, ensuring quality standards, documentation, and delivery timelines. Technical Skills Languages: Python, PySpark, SQL Platforms: Databricks (Jobs, Workflows, Delta Live Tables, Unity Catalog), GCP Dataproc Data Tools: Hadoop, Hive, Pig, Spark (RDD & DataFrame APIs), Delta Lake Cloud & Integration: GCS, BigQuery, Pub/Sub, Cloud Composer, Airflow Automation: GenAI-powered migration tools, custom Python utilities for code conversion Version Control & DevOps: Git, Terraform, Jenkins, CI/CD pipelines Other: Performance tuning, cost optimization, and lineage tracking with Unity Catalog Preferred Experience 10–14 years of data engineering experience with at least 3 years leading Databricks or Spark modernization programs. Proven success in migration or replatforming projects from Hadoop or Dataproc to Databricks. Exposure to AI/GenAI in code transformation or data engineering automation . Strong stakeholder management and technical leadership skills. EXPERIENCE 11-12 Years SKILLS Primary Skill: Data Engineering Sub Skill(s): Data Engineering Additional Skill(s): Python, Apache Hadoop, Apache Hive, Apache Airflow, synapse, databricks, SQL, Apache Spark, Azure Data Factory, Pyspark, GenAI Fundamentals, Cloud Pub/Sub, BigQuery ABOUT THE COMPANY Infogain is a human-centered digital platform and software engineering company based out of Silicon Valley. We engineer business outcomes for Fortune companies and digital natives in the technology, healthcare, insurance, travel, telecom, and retail & CPG industries using technologies such as cloud, microservices, automation, IoT, and artificial intelligence. We accelerate experience-led transformation in the delivery of digital platforms. Infogain is also a Microsoft (NASDAQ: MSFT) Gold Partner and Azure Expert Managed Services Provider (MSP). Infogain, an Apax Funds portfolio company, has offices in California, Washington, Texas, the UK, the UAE, and Singapore, with delivery centers in Seattle, Houston, Austin, Kraków, Noida, Gurgaon, Mumbai, Pune, and Bengaluru.
-
Azure Data Engineer
10 hours ago
Gurugram, India Epergne Solutions Full timeJob Title : Azure Data Engineer Location : Remote Experience : 5 +Years Notice Period : 15 Days / Immediate Only Primary Responsibilities: Design, develop, and maintain data storage solutions using Azure SQL Database , Azure Data Lake , and Azure Blob Storage . Build and manage data pipelines for ingestion, processing, and transformation within Azure. Create...
-
Azure Data Engineer
3 weeks ago
Gurugram, India Skillkart Consultancy Full timeDescription :Key Responsibilities :- Design and build secure, scalable, and reliable data pipelines using Azure Data Factory, Synapse Analytics, and other Azure services.- Develop ETL/ELT processes to ingest data from multiple sources including APIs, databases, and flat files.- Work with structured and unstructured data to support analytics, data science,...
-
Azure Data Engineer
12 hours ago
Gurugram, India Absolutdata Full timeLocation : Gurgaon Experience : 4-8 years Experience as Data Engineer with database design experience. Strong hands-on experience in designing data lakes / date warehouses Proficient in designing relation and NoSQL entities Proficient in creating Azure Data Factory pipelines for on-cloud ETL processing; copy activity,custom Azure development etc. Proficient...
-
Data Engineer
4 weeks ago
Gurugram, India SkillKart Full timeDescription :Role Overview :We are seeking a skilled Data Engineer with expertise in Microsoft Azure to join our Data & Analytics team. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and architectures using Azure data services. You will collaborate with cross-functional teams including data scientists,...
-
Data Engineer
1 week ago
Gurugram, India One Degree North HR Services Full timeJob Description : Function : Data Science and Analysis ? Data Analysis / Business Intelligence, Software Engineering ? Big Data / DWH / ETLDatabricks Data AnalysisETL+5 more Data Warehousing Spark SQLAzure Data Factory Azure SynapseRequirements : - 5 years of experience in data engineering, with at least 3+ years in Azure Databricks.- Strong proficiency in...
-
Azure Data Engineer
3 weeks ago
Gurugram, India ACENET CONSULTING PRIVATE LIMITED Full timeDescription :About Us :AceNet Consulting is a fast-growing global business and technology consulting firm specializing in business strategy, digital transformation, technology consulting, product development, start-up advisory and fund-raising services to our global clients across banking & financial services, healthcare, supply chain & logistics, consumer...
-
Data Engineer
4 weeks ago
Gurugram, India Ixceed Solutions Full timeJob Description : We are seeking a skilled Data Engineer with strong expertise in Azure data services to design and implement effective data solutions, support data quality, and contribute to cloud migration strategies. This role is key in building scalable data pipelines, maintaining data integrity, and collaborating on data architecture best practices...
-
EXL - Data Engineer - Azure Data Services
1 week ago
Gurugram, India EXL Full timeRole Summary : We are looking for a skilled Data Engineer with solid experience in the Azure data ecosystem and hands-on expertise in Azure Databricks. The ideal candidate will have worked on designing and developing scalable, cloud-native data pipelines and solutions using Azure data services. You will contribute to building and optimizing data lakehouse...
-
Azure Data Engineer
3 days ago
Gurugram, India AceNet Full timeDescription :Job Summary :We are seeking experienced and technically proficient Azure Data Engineers to join our team. You should be well versed in coding, spark core and data ingestion using Azure. Experience with core Azure DE skills and coding skills (pyspark, python and SQL).Key Responsibilities :- Create and maintain data storage solutions including...
-
Data Engineer
3 weeks ago
Gurugram, India Ixceed Solutions Full timeDescription :- Integrating data from various sources into a unified Azure data warehouse and suitable data marts.- Continuously monitoring and testing the availability, performance and quality of data pipelines.- Collaborating with peers by employing and following SDLC best practice while maintaining code repositories and activity using Agile, DevOps and...