Hadoop Development Lead

2 weeks ago

Hyderabad, India ValueMomentum Full time

Job Title: Hadoop Development Lead

Primary Skill: PySpark , Hadoop, Hive, SQL, must have worked as team lead for minimum 2-3 years.

Location: Hyderabad/Pune/Coimbatore

Mode of Work: Hybrid

Experience: 7-10 years

About the Job :

We are seeking an experienced Hadoop Data Engineer to join our team- a team of high-energy individuals who thrive in a rapid-pace and agile product development environment. The ideal candidate will have extensive experience in Hadoop development, strong knowledge of PySpark programming, and expertise in Hadoop, Hive framework. You will be responsible for writing complex SQL queries.

Know your team:

At ValueMomentum’s Engineering Center , we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.

Join a team that invests in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You’ll have the opportunity to showcase your talents by contributing to impactful projects.

Responsibilities:

Batch Processing Optimization: Analyse and optimize existing batch workflows to ensure efficient data processing. Development & Scripting: Write and maintain batch scripts using Python, Hive, and Shell to automate data workflows. Data Analysis: Utilize Hadoop and related technologies to gather, analyse, and report on data performance and processing metrics. Troubleshooting: Identify and resolve data processing bottlenecks and workflow issues to minimize downtime and ensure smooth operations. Collaboration: Work closely with data engineering, data science, and business intelligence teams to understand requirements and improve the data pipeline. Documentation: Develop and maintain technical documentation for workflows, troubleshooting guides, and best practices. Continuous Improvement: Propose and implement improvements for existing batch processes and pipelines.

Requirements:

5-7 years of experience in batch processing optimization and data workflows, with a strong focus on Hadoop, Python, Hive, and Shell scripting. Proficient in Hadoop ecosystem tools (HDFS, YARN, etc.). Strong knowledge of Python for data processing and automation. Advanced proficiency in Hive query language. Expertise in writing Shell scripts for Linux/Unix environments. Strong troubleshooting and performance analysis skills to optimize workflows. Excellent communication and collaboration skills with a problem-solving mindset. Familiarity with Agile methodologies. Experience working in cross-functional teams.

  • Hadoop Development Lead

    2 weeks ago

    Hyderabad, India ValueMomentum Full time

    Job Title: Hadoop Development Lead Primary Skill: PySpark , Hadoop, Hive, SQL, must have worked as team lead for minimum 2-3 years. Location: Hyderabad/Pune/Coimbatore Mode of Work: Hybrid Experience: 7-10 years About the Job : We are seeking an experienced Hadoop Data Engineer to join our team- a team of...

  • Hadoop Development Developer

    4 weeks ago

    Hyderabad, India Phygital Insights Full time

    Full time | Work From Office This Position is Currently Open Department / Category: DEVELOPER Listed on Sep 18, 2025 Work Location: HYDERABAD Job Descritpion of Hadoop Development Developer 6 to 8 Years Relevant Experience About the Role We're looking for a Big Data Engineer to design, develop, and maintain scalable data systems and pipelines. The role...

  • Hadoop Development Developer

    6 days ago

    Hyderabad, Telangana, India Phygital Insights Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    Full time|Work From OfficeThis Position is Currently OpenDepartment / Category:DEVELOPERListed on Sep 18, 2025Work Location:HYDERABADJob Descritpion of Hadoop Development Developer6 to 8 Years Relevant ExperienceAbout the RoleWe're looking for a Big Data Engineer to design, develop, and maintain scalable data systems and pipelines. The role requires strong...

  • Hadoop Developer

    1 week ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Description SN Required Information Details 1 Role Developer / Module Lead 2 Required Technical Skill Set Hadoop 3 Desired Experience Range 4-8Yrs 4 Location of Requirement - Chennai, Hyderabad, Bangalore, Mumbai, Indore, Ahmedabad 5 Desired Competencies (Technical/Behavioral Competency) Must-Have Extensive experience and hands on implementation...

  • Hadoop Developer

    2 days ago

    hyderabad, India Tata Consultancy Services Full time

    Job Description SN Required Information Details 1 Role Developer / Module Lead 2 Required Technical Skill Set Hadoop 3 Desired Experience Range 4-8Yrs 4 Location of Requirement - Chennai, Hyderabad, Bangalore, Mumbai, Indore, Ahmedabad 5 Desired Competencies (Technical/Behavioral Competency) Must-Have Extensive experience and hands on implementation...

  • Hadoop Developers

    6 hours ago

    Bengaluru, Hyderabad, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 1,80,000 - ₹ 2,40,000 per year

    We are looking for skilled Hadoop Developers with 7-10 years of experience to join our team in Bangalore and Hyderabad.Roles and ResponsibilityDesign, develop, and implement scalable data processing systems using Hadoop and Spark.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and maintain large-scale data...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, India NTT Full time

    JOB DESCRIPTION Req ID:     We are currently seeking a Python/Hadoop Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently seeks Python Hadoop Developer to join our team in Responsibilities Skillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AI Responsibilities: Data Ingestion Pipelines, AIML...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, India NTT Full time

    JOB DESCRIPTION Req ID:     We are currently seeking a Python/Hadoop Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently seeks Python Hadoop Developer to join our team in Responsibilities Skillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AI Responsibilities: Data Ingestion Pipelines, AIML Model...

  • Python/Hadoop Developer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA, Inc. Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    NTT DATA Services currently seeks Python Hadoop Developer to join our team inResponsibilitiesSkillset: Python, Hadoop, ETL, RDBMS, Unix, GCP Vertex AIResponsibilities:Data Ingestion Pipelines, AIML Model deployments, Data Engineering, ML Engineering with Python.

  • Senior Hadoop Developer

    4 weeks ago

    Hyderabad, India Careernet Full time

    Key Skills: Hadoop, SCALA, Pyspark, Functional Programming, SQL, Scala Build Tool, Linux Roles & Responsibilities: Develop and maintain scalable data processing applications using Hadoop and SCALA. Implement functional programming techniques to enhance code efficiency and maintainability. Collaborate with cross-functional teams to design and optimize data...