Senior Hadoop Developer

3 weeks ago


Hyderabad, Telangana, India ValueMomentum Full time

About ValueMomentum's Engineering Center

At ValueMomentum, we're a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.

Key Responsibilities

  1. Batch Processing Optimization: Analyze and optimize existing batch workflows to ensure efficient data processing.
  2. Development & Scripting: Write and maintain batch scripts using Python, Hive, and Shell to automate data workflows.
  3. Data Analysis: Utilize Hadoop and related technologies to gather, analyze, and report on data performance and processing metrics.
  4. Troubleshooting: Identify and resolve data processing bottlenecks and workflow issues to minimize downtime and ensure smooth operations.
  5. Collaboration: Work closely with data engineering, data science, and business intelligence teams to understand requirements and improve the data pipeline.
  6. Documentation: Develop and maintain technical documentation for workflows, troubleshooting guides, and best practices.
  7. Continuous Improvement: Propose and implement improvements for existing batch processes and pipelines.

Requirements

  1. 5-7 years of experience in batch processing optimization and data workflows, with a strong focus on Hadoop, Python, Hive, and Shell scripting.
  2. Proficient in Hadoop ecosystem tools (HDFS, YARN, etc.).
  3. Strong knowledge of Python for data processing and automation.
  4. Advanced proficiency in Hive query language.
  5. Expertise in writing Shell scripts for Linux/Unix environments.
  6. Strong troubleshooting and performance analysis skills to optimize workflows.
  7. Excellent communication and collaboration skills with a problem-solving mindset.
  8. Familiarity with Agile methodologies.
  9. Experience working in cross-functional teams.

What We Offer

At ValueMomentum, we invest in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.



  • Hyderabad, Telangana, India Virtusa Full time

    Virtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...


  • Hyderabad, Telangana, India ValueMomentum Full time

    About the Role:We are seeking an experienced Hadoop Data Engineer to join our team at ValueMomentum. The ideal candidate will have extensive experience in Hadoop development, strong knowledge of PySpark programming, and expertise in Hadoop, Hive framework.Key Responsibilities:Batch Processing Optimization: Analyze and optimize existing batch workflows to...


  • Hyderabad, Telangana, India SMARTWORK IT SERVICES Full time

    Job SummaryAt SMARTWORK IT SERVICES, we are seeking a skilled Hadoop Developer to join our team. The ideal candidate will have strong expertise in Hadoop, MapReduce, and either Java or Python, along with Data Structures and Algorithms knowledge.Key Responsibilities- Develop and evolve highly scalable, fault-tolerant distributed components using Hadoop...

  • Data Engineer

    1 month ago


    Hyderabad, Telangana, India DBS Bank Full time

    Job SummaryDBS Bank is seeking a highly skilled Hadoop Data Engineer to join our Middle Office Technology team. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key ResponsibilitiesDesign and develop scalable data processing pipelines using...


  • Hyderabad, Telangana, India ValueMomentum Full time

    Hadoop Data Ingestion ExpertiseWe are looking for a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a key member of our quality engineering team, you will be responsible for testing and validating our Hadoop data ingestion pipelines to ensure they meet the highest standards of quality and reliability.About the RoleDesign, develop, and...


  • Hyderabad, Telangana, India ValueMomentum Full time

    Job Summary:We are seeking a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for testing products or systems to ensure they function properly and meet business needs.Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion...

  • Senior Java Developer

    1 month ago


    Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Java DeveloperJob Summary:We are seeking a highly skilled Senior Java Developer to join our team at Virtusa. The ideal candidate will have extensive experience in Java, Spark, and Big Data technologies.Key Responsibilities:Design and develop large-scale data processing systems using Java and SparkCollaborate with cross-functional teams to...


  • Hyderabad, Telangana, India ValueMomentum Full time

    Job Summary:We are seeking a skilled Hadoop Tester to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for ensuring the quality and reliability of our data pipelines. Your primary focus will be on testing and validating our Hadoop data ingestion processes to guarantee the completeness, correctness, and timeliness of the...


  • Hyderabad, Telangana, India Aricent Full time

    Job DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...

  • Big Data Engineer

    2 months ago


    Hyderabad, Telangana, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full time

    Responsibilities of the Candidate :- Be responsible for the design and development of big data solutions. - Partner with domain experts, product managers, analysts, and data scientists to develop Big Data pipelines in Hadoop- Be responsible for moving all legacy workloads to a cloud platform- Work with data scientists to build Client pipelines using...


  • Hyderabad, Telangana, India ValueMomentum Full time

    {"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...


  • Hyderabad, Telangana, India Virtusa Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.ResponsibilitiesDesign and implement data processing pipelines using Python...


  • Hyderabad, Telangana, India Vidpro Consultancy Services Full time

    Job Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...


  • Hyderabad, Telangana, India Virtusa Full time

    Job Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...


  • Hyderabad, Telangana, India Daxx Full time

    As a Senior Big Data Engineer at Grid Dynamics, you will be responsible for designing and implementing large-scale data processing systems, working with big data technologies like Hadoop, Spark, and NoSQL databases. Your expertise in Python programming, data modeling, and data transformation will be critical in delivering high-quality solutions to our...

  • Senior Data Analyst

    1 month ago


    Hyderabad, Telangana, India Ivy comptech Full time

    About The RoleAt Ivy Comptech, we are seeking a highly skilled Senior Data Analyst to contribute to various phases and activities of the software development process or software testing. The ideal candidate will be willing to work in a fast-paced, multi-tasking, team environment, collaborating with tech leads, software engineers, internal partners, and...

  • Senior Data Analyst

    3 weeks ago


    Hyderabad, Telangana, India Ivy comptech Full time

    About The RoleAs a Senior Data Analyst at Ivy Comptech, you will contribute to various phases and activities of the software development process or software testing. You will work in a fast-paced, multi-tasking, team environment with tech leads, software engineers, internal partners, and stakeholders.Key Responsibilities:Strong understanding of Apache Druid...


  • Hyderabad, Telangana, India UnitedHealth Group Full time

    At UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Senior Software Development Engineer, you'll play a critical role in designing, developing, and implementing software solutions that improve health outcomes and advance health equity on a global scale.The ideal candidate...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Mempage Full time

    About the Role : We are seeking a highly skilled Big Data Engineer to contribute to the design, development, and maintenance of our data infrastructure. As a key member of our team, you will be responsible for building and optimizing data pipelines to support our business analytics and machine learning initiatives. Your expertise will be instrumental in...