Senior Hadoop Developer
3 weeks ago
About ValueMomentum's Engineering Center
At ValueMomentum, we're a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through a strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise.
Key Responsibilities
- Batch Processing Optimization: Analyze and optimize existing batch workflows to ensure efficient data processing.
- Development & Scripting: Write and maintain batch scripts using Python, Hive, and Shell to automate data workflows.
- Data Analysis: Utilize Hadoop and related technologies to gather, analyze, and report on data performance and processing metrics.
- Troubleshooting: Identify and resolve data processing bottlenecks and workflow issues to minimize downtime and ensure smooth operations.
- Collaboration: Work closely with data engineering, data science, and business intelligence teams to understand requirements and improve the data pipeline.
- Documentation: Develop and maintain technical documentation for workflows, troubleshooting guides, and best practices.
- Continuous Improvement: Propose and implement improvements for existing batch processes and pipelines.
Requirements
- 5-7 years of experience in batch processing optimization and data workflows, with a strong focus on Hadoop, Python, Hive, and Shell scripting.
- Proficient in Hadoop ecosystem tools (HDFS, YARN, etc.).
- Strong knowledge of Python for data processing and automation.
- Advanced proficiency in Hive query language.
- Expertise in writing Shell scripts for Linux/Unix environments.
- Strong troubleshooting and performance analysis skills to optimize workflows.
- Excellent communication and collaboration skills with a problem-solving mindset.
- Familiarity with Agile methodologies.
- Experience working in cross-functional teams.
What We Offer
At ValueMomentum, we invest in your growth. Our Infinity Program empowers you to build your career with role-specific skill development leveraging immersive learning platforms. You'll have the opportunity to showcase your talents by contributing to impactful projects.
-
Senior Big Data Developer
3 days ago
Hyderabad, Telangana, India Virtusa Full timeVirtusa seeks a seasoned Senior Big Data Developer to spearhead the development of large-scale data processing systems using Hadoop and Spark. As a key member of our team, you will design, implement, and deploy complex big data solutions that drive business growth and innovation.Job SummaryWe are looking for an experienced Senior Big Data Developer with a...
-
Hadoop Development Lead
1 month ago
Hyderabad, Telangana, India ValueMomentum Full timeAbout the Role:We are seeking an experienced Hadoop Data Engineer to join our team at ValueMomentum. The ideal candidate will have extensive experience in Hadoop development, strong knowledge of PySpark programming, and expertise in Hadoop, Hive framework.Key Responsibilities:Batch Processing Optimization: Analyze and optimize existing batch workflows to...
-
Expert Hadoop Developer
2 weeks ago
Hyderabad, Telangana, India SMARTWORK IT SERVICES Full timeJob SummaryAt SMARTWORK IT SERVICES, we are seeking a skilled Hadoop Developer to join our team. The ideal candidate will have strong expertise in Hadoop, MapReduce, and either Java or Python, along with Data Structures and Algorithms knowledge.Key Responsibilities- Develop and evolve highly scalable, fault-tolerant distributed components using Hadoop...
-
Data Engineer
1 month ago
Hyderabad, Telangana, India DBS Bank Full timeJob SummaryDBS Bank is seeking a highly skilled Hadoop Data Engineer to join our Middle Office Technology team. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data processing systems using Hadoop and Spark technologies.Key ResponsibilitiesDesign and develop scalable data processing pipelines using...
-
Senior Hadoop Data Ingestion Engineer
3 weeks ago
Hyderabad, Telangana, India ValueMomentum Full timeHadoop Data Ingestion ExpertiseWe are looking for a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a key member of our quality engineering team, you will be responsible for testing and validating our Hadoop data ingestion pipelines to ensure they meet the highest standards of quality and reliability.About the RoleDesign, develop, and...
-
Hadoop Data Ingestion Specialist
1 month ago
Hyderabad, Telangana, India ValueMomentum Full timeJob Summary:We are seeking a skilled Hadoop Testing Engineer to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for testing products or systems to ensure they function properly and meet business needs.Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion...
-
Senior Java Developer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Java DeveloperJob Summary:We are seeking a highly skilled Senior Java Developer to join our team at Virtusa. The ideal candidate will have extensive experience in Java, Spark, and Big Data technologies.Key Responsibilities:Design and develop large-scale data processing systems using Java and SparkCollaborate with cross-functional teams to...
-
Hadoop Data Ingestion Tester
4 weeks ago
Hyderabad, Telangana, India ValueMomentum Full timeJob Summary:We are seeking a skilled Hadoop Tester to join our team at ValueMomentum. As a Hadoop Testing Engineer, you will be responsible for ensuring the quality and reliability of our data pipelines. Your primary focus will be on testing and validating our Hadoop data ingestion processes to guarantee the completeness, correctness, and timeliness of the...
-
Hyderabad, Telangana, India Aricent Full timeJob DescriptionWe are seeking a skilled Senior Big Data Engineer to design and build solutions for a Fortune 500 client program. The project involves creating a data standardized and curation-based Hadoop cluster.About the RoleThis is a high-visibility, fast-paced key initiative that will integrate data across internal and external sources, provide...
-
Big Data Engineer
2 months ago
Hyderabad, Telangana, India TECHSTAR SOFTWARE DEVELOPMENT INDIA PVT LTD Full timeResponsibilities of the Candidate :- Be responsible for the design and development of big data solutions. - Partner with domain experts, product managers, analysts, and data scientists to develop Big Data pipelines in Hadoop- Be responsible for moving all legacy workloads to a cloud platform- Work with data scientists to build Client pipelines using...
-
Hadoop Software Quality Engineer
3 weeks ago
Hyderabad, Telangana, India ValueMomentum Full time{"Responsibilities": "Key Responsibilities:Design, develop, and execute test plans and test cases for our Hadoop data ingestion pipelines.Ensure the completeness, correctness, and timeliness of data ingested into Hadoop. Validate source to target data mapping and transformations.Evaluate the performance and scalability of our data ingestion processes and...
-
Hyderabad, Telangana, India Virtusa Full timeAbout the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Virtusa. As a key member of our engineering team, you will design, develop, and maintain large-scale data processing pipelines using big data technologies such as Hadoop, MapReduce, Hive, and Spark.ResponsibilitiesDesign and implement data processing pipelines using Python...
-
Senior Big Data Engineer
4 weeks ago
Hyderabad, Telangana, India Vidpro Consultancy Services Full timeJob Title: Senior Big Data EngineerJob Summary: Vidpro Consultancy Services is seeking a highly skilled Senior Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale big data architectures using Java, Python, and Hadoop technologies.Responsibilities:Design...
-
Senior Big Data Engineer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior Big Data EngineerJob Summary:We are seeking a Senior Big Data Engineer to join our team at Virtusa. The ideal candidate will have a strong background in designing, building, and supporting data applications using Spark, Sqoop, and Hive.Key Responsibilities:Design and develop complex data applications using Spark, Sqoop, and Hive.Work with...
-
Senior PySpark Developer
1 month ago
Hyderabad, Telangana, India Virtusa Full timeJob Title: Senior PySpark DeveloperWe are seeking a highly skilled Senior PySpark Developer to join our team at Virtusa.Key Responsibilities:Design, develop, and maintain large-scale data processing pipelines using PySpark.Collaborate with cross-functional teams to identify business requirements and develop solutions.Develop and maintain CI/CD pipelines to...
-
Senior Data Engineering Expert
3 weeks ago
Hyderabad, Telangana, India Daxx Full timeAs a Senior Big Data Engineer at Grid Dynamics, you will be responsible for designing and implementing large-scale data processing systems, working with big data technologies like Hadoop, Spark, and NoSQL databases. Your expertise in Python programming, data modeling, and data transformation will be critical in delivering high-quality solutions to our...
-
Senior Data Analyst
1 month ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout The RoleAt Ivy Comptech, we are seeking a highly skilled Senior Data Analyst to contribute to various phases and activities of the software development process or software testing. The ideal candidate will be willing to work in a fast-paced, multi-tasking, team environment, collaborating with tech leads, software engineers, internal partners, and...
-
Senior Data Analyst
3 weeks ago
Hyderabad, Telangana, India Ivy comptech Full timeAbout The RoleAs a Senior Data Analyst at Ivy Comptech, you will contribute to various phases and activities of the software development process or software testing. You will work in a fast-paced, multi-tasking, team environment with tech leads, software engineers, internal partners, and stakeholders.Key Responsibilities:Strong understanding of Apache Druid...
-
Senior Software Development Engineer
1 month ago
Hyderabad, Telangana, India UnitedHealth Group Full timeAt UnitedHealth Group, we're committed to helping people live healthier lives and making the health system work better for everyone. As a Senior Software Development Engineer, you'll play a critical role in designing, developing, and implementing software solutions that improve health outcomes and advance health equity on a global scale.The ideal candidate...
-
Big Data Engineer
3 weeks ago
Hyderabad, Telangana, India Mempage Full timeAbout the Role : We are seeking a highly skilled Big Data Engineer to contribute to the design, development, and maintenance of our data infrastructure. As a key member of our team, you will be responsible for building and optimizing data pipelines to support our business analytics and machine learning initiatives. Your expertise will be instrumental in...