Data Engineer – Hadoop
2 days ago
We are seeking an experienced
Data Engineer
with strong expertise in the
Hadoop ecosystem
and
PySpark
. The ideal candidate should have a deep understanding of large-scale data processing, data pipelines, and automation using Python.
Key Responsibilities
- Design, develop, and optimize
data pipelines
using Hadoop and PySpark. - Work extensively on
HDFS, Hive, and Spark
for data ingestion, transformation, and analysis. - Implement
data models, ETL frameworks,
and performance tuning strategies. - Collaborate with data scientists and analysts to ensure data quality and accessibility.
- Develop
Python-based automation scripts
to streamline data engineering workflows. - Ensure data integrity, governance, and scalability across distributed systems.
Required Skills & Qualifications
- Strong hands-on experience
with the
Hadoop ecosystem
(HDFS, Hive, Spark, etc.) –
Mandatory - Proficiency in PySpark
for large-scale data processing –
Mandatory - Strong Python programming skills
for data manipulation and automation –
Mandatory - Experience with
ETL design, data modeling,
and
distributed computing frameworks - Familiarity with
big data storage formats
(Parquet, ORC, Avro, etc.) - Strong understanding of
SQL
and
data performance optimisation - Excellent problem-solving, debugging, and communication skills
Good to Have
- Exposure to
cloud data platforms
(AWS EMR, Azure HDInsight, or GCP Dataproc) - Experience with
Airflow, Kafka, or NiFi - Knowledge of
data security, governance, and CI/CD automation
How to Apply
Interested candidates can share their resume with the subject line
"Application – Data Engineer (Hadoop)"
at "" or apply directly via LinkedIn.
-
Hadoop Platform Engineer
1 week ago
Bengaluru, Karnataka, India Andor Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearWe're Hiring: Hadoop Platform EngineerAre you an expert inApache Hadoop, Hive, Spark, Java, and Linux? Join us to build and maintain ascalable, high-performance data platformthat powers large-scale analytics. Location: Manyata Tech Park, Bangalore Experience: 10+ Years Company: Andor Tech (Deployed at a Product-Based Retail MNC)Key Skills: Apache Hadoop...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Data Engineering Subject Matter Expert
1 week ago
Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 4,80,000 - US$ 12,00,000 per yearWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Staff Apache Hadoop Engineer
2 weeks ago
Bengaluru, Karnataka, India BairesDev Full time ₹ 1,50,000 - ₹ 2,50,000 per yearAt BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.When you apply for this position, you're...
-
Hadoop Admin
1 week ago
Bengaluru, Karnataka, India PineQ Lab Technology Full time ₹ 4,00,000 - ₹ 8,00,000 per yearCompany DescriptionPineQ Lab Technology is committed to fostering innovation and advancing digital transformation by connecting top tech talent with visionary companies. With a strong focus on personalization, we tailor our services to address the unique needs of both candidates and organizations. Leveraging extensive expertise and a robust network in the...
-
Hadoop Developer
2 weeks ago
Bengaluru, Karnataka, India Coders Brain Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per yearPosition : Hadoop Developer Experience: 6+ Years Location : Chennai/Bangalore(Work from Office) Mandatory Skill- pySpark,Hadoop,GCP, Python • Professional experience with a cloud platform • Developer must have sound knowledge in Apache Spark and Python programming. • Deep experience in developing data processing tasks using pySpark such as...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India 3K Softech Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearJob Role: Data EngineerExp: 5+ YearsLoc: BangaloreDeep Hadoop ecosystem knowledge: Spark, HDFS, Hive, Iceberg.Batch and streaming ETL pipeline design scalability and reliabilityPython & Unix proficiency, materialized views, data structures/algorithms.Data warehouse security, compliance, and operational excellence.Automated pipeline design & optimization,...
-
Hadoop Admin
1 week ago
Bengaluru, Karnataka, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob DescriptionJob Title: Hadoop AdminReq Id: 110738City: BengaluruState/Province: KarnatakaPosting Start Date: 11/12/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...
-
Cloud/Snowflake Support Engineer
1 week ago
Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 60,000 - US$ 1,20,000 per yearWe're Hiring:Cloud/Snowflake Support Engineer( SME Coach)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...
-
Hadoop Administrator
6 days ago
Bengaluru, Karnataka, India Andor Tech Full time ₹ 4,00,000 - ₹ 16,00,000 per yearWe're Hiring – Contract RoleLooking for experienced Big Data professionals with7+ yearsin:HadoopZookeeperSparkIf you're available for a contract opportunity and have strong hands-on expertise in distributed systems, please connect