Data Engineer – Hadoop
3 days ago
We are seeking an experienced
Data Engineer
with strong expertise in the
Hadoop ecosystem
and
PySpark
. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.
Key Responsibilities
- Design, develop, and optimize
data pipelines
using Hadoop and PySpark. - Work extensively on
HDFS, Hive, and Spark
for data ingestion, transformation, and analysis. - Implement
data models, ETL frameworks,
and performance tuning strategies. - Collaborate with data scientists and analysts to ensure data quality and accessibility.
- Develop
Python-based automation scripts
to streamline data engineering workflows. - Ensure data integrity, governance, and scalability across distributed systems.
Required Skills & Qualifications
- Strong hands-on experience
with the
Hadoop ecosystem
(HDFS, Hive, Spark, etc.) –
Mandatory - Proficiency in PySpark
for large-scale data processing –
Mandatory - Strong Python programming skills
for data manipulation and automation –
Mandatory - Experience with
ETL design, data modeling,
and
distributed computing frameworks - Familiarity with
big data storage formats
(Parquet, ORC, Avro, etc.) - Strong understanding of
SQL
and
data performance optimisation - Excellent problem-solving, debugging, and communication skills
Good to Have
- Exposure to
cloud data platforms
(AWS EMR, Azure HDInsight, or GCP Dataproc) - Experience with
Airflow, Kafka, or NiFi - Knowledge of
data security, governance, and CI/CD automation
How to Apply
Interested candidates can share their resume with the subject line
"Application – Data Engineer (Hadoop)"
at "" or apply directly via LinkedIn.
-
Big Data/Hadoop Engineer
2 days ago
Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...
-
Big Data/Hadoop Engineer
2 days ago
Bengaluru, Karnataka, India Rackspace Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are hiring for Big Data / Hadoop EngineerExp - 3+yrs Location - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Hadoop Platform Engineer
2 weeks ago
Bengaluru, Karnataka, India Andor Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe're Hiring: Hadoop Platform EngineerAre you an expert inApache Hadoop, Hive, Spark, Java, and Linux? Join us to build and maintain ascalable, high-performance data platformthat powers large-scale analytics. Location: Manyata Tech Park, Bangalore Experience: 10+ Years Company: Andor Tech (Deployed at a Product-Based Retail MNC)Key Skills: Apache Hadoop...
-
Apache Hadoop Developer
2 weeks ago
Bengaluru, Karnataka, India BairesDev Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAt BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.When you apply for this position, you're...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India 3K Softech Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Role: Data EngineerExp: 5+ YearsLoc: BangaloreDeep Hadoop ecosystem knowledge: Spark, HDFS, Hive, Iceberg.Batch and streaming ETL pipeline design scalability and reliabilityPython & Unix proficiency, materialized views, data structures/algorithms.Data warehouse security, compliance, and operational excellence.Automated pipeline design & optimization,...
-
Hadoop Admin
2 weeks ago
Bengaluru, Karnataka, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob DescriptionJob Title: Hadoop AdminReq Id: 110738City: BengaluruState/Province: KarnatakaPosting Start Date: 11/12/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...
-
Sr Data Engineer
4 days ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Duties:At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution.Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must.Strong Application development experience in Scala/Python. Strong Database SQL experience,...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India Clover Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description:Position: Data EngineerLocation: BangaloreExp: 6 to 15 yrsSkills required:Having good development and design experience as Data Engineer.Strong experience in PySpark, Spark, Python, Hadoop eco-system.Experience on Big Data platforms and distributed computing (e.g. Hadoop, Map/Reduce, Spark, HBase, Hive).Experience in data pipeline software...
-
Data Engineer
3 days ago
Bengaluru, Karnataka, India InstaVision Inc Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Data EngineerLocation:Bangalore (Manyata Tech Park)Employment Type:PermanentWork Mode:Work from Office – 5 DaysInterview Mode:Face-to-Face (Tomorrow, 30th Oct 2025 – Manyata Tech Park, Bangalore)Notice Period:Immediate Joiners OnlyAbout the Role:We are looking for a skilledData Engineerwith strong experience inPython, Hadoop, and HIVEto join...