
Data Engineer
1 day ago
Job Description:
Must Have:
- Must have 6+Years of experience
- Programming Language: Python
- AWS Services: IAM, Networking, Lake Formation, EMR, MWAA, Athena, Glue ETL, Glue Catalog, S3, Lambda, API Gateway, Event Bridge, SQS, SNS, Kinesis, DMS
- Automation: Terraform (IaC), GitHub Actions
- UI Tech (for a few resources): Angular
- Architecture: Data Mesh, Micro Services
Strong Experience in PySpark:
- Hands-on expertise in building scalable data pipelines using PySpark.
- Proficiency in using Spark SQL, DataFrame, and RDD APIs to implement complex business logic.
Proficient Programming Skills:
- Solid coding skills in Python (preferred), with strong fundamentals in data structures, algorithms, and software engineering principles.
Data Pipeline Development:
- Proven experience designing, developing, and maintaining batch and streaming data pipelines.
- Understanding of ETL/ELT processes and best practices for data transformation, data quality, and performance optimization.
Knowledge of Modern Data Engineering Ecosystem:
- Familiarity with the current data engineering landscape including distributed data processing, storage systems, and workflow orchestration tools.
- Tools/technologies could include Apache Airflow, dbt, Delta Lake, etc.
Cloud Data Platform Experience (Preferably AWS)
- Experience working with cloud services such as:
- AWS S3 (data lake)
- AWS Glue / EMR (for Spark workloads)
- AWS Lambda, Step Functions, or similar for orchestration/integration
- Redshift or other cloud data warehouses
Spark API Expertise for Business Logic Implementation
- Ability to choose and apply the right Spark APIs (Data Frame, Dataset, RDD) for performance-efficient implementation of business logic at scale.
-
Data Engineer
1 day ago
Mumbai, Maharashtra, India, Maharashtra SolarSquare Full timeJob Description: Data EngineerAs a Data Engineer, you will own the end-to-end lifecycle of our data infrastructure. You willdesign and implement robust, scalable data pipelines and architect modern data solutionsusing a best-in-class technology stack. Your work will transform raw, messy data into clean,reliable, and actionable data products that power...
-
Data Engineer
4 days ago
Mumbai, Maharashtra, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Data Engineer
4 days ago
Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFID Federal Risk Applications Data Engineer Req ID: 341951 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in...
-
Data Engineer
1 day ago
Mumbai, Maharashtra, India, Maharashtra Deloitte Full timeYour potential, unleashed.India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organisations shaping the future of the region, and indeed, the world beyond.At Deloitte, your whole self to work, every day. Combine that with our...
-
Data Ingest Engineer
2 weeks ago
Mumbai, Maharashtra, India NTT DATA North America Full time ₹ 9,00,000 - ₹ 12,00,000 per yearAs a Data Ingest Engineer at NTT DATA in Pune, Maharashtra, India, you will be an integral part of the Ingestion team of the DRIFT data ecosystem. Your primary focus will be on ingesting data in a timely, complete, and comprehensive manner using the latest technology available to Citi. It is imperative that you leverage new and creative methods for...
-
Data Platform Engineer
1 day ago
Mumbai, Maharashtra, India, Maharashtra World Wide Technology Full timeWorld Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome.Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others,...
-
Big Data Engineer
1 day ago
Mumbai, Maharashtra, India, Maharashtra HirePower Staffing Solution Full timePosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Data Engineer
6 hours ago
Mumbai, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per yearData Engineer Req ID: 340021 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Mumbai, Mahārāshtra (IN-MH), India (IN). Job Duties: Key...
-
Senior Data Engineer
1 day ago
Mumbai, Maharashtra, India, Maharashtra A.P. Moller - Maersk Full timeMaersk Line Fleet Management and Technology is responsible for Ship Management of Maersk Line owned container vessels. As a part of the Energy Transition Transparency and Enablement team you will be responsible for developing the strong enterprise architecture, building effective data pipelines based on ADLS/MIDAS and providing end-to-end support on energy...
-
Data Engineer
1 day ago
Navi Mumbai, Maharashtra, India, Maharashtra Celebal Technologies Full timeJob Description – ETL Migration Specialist (Informatica to Databricks)Position OverviewWe are looking for an experienced ETL Migration Specialist with strong expertise in Informatica PowerCenter and Databricks (PySpark). The ideal candidate will be responsible for analysing and reverse engineering existing Informatica mappings/workflows, understanding the...