Hadoop Developer with Java
2 weeks ago
Job Description:
We are seeking a skilled and experienced Hadoop Developer with expertise in Java and Kafka to join our team.
The ideal candidate will play a crucial role in designing, developing, and maintaining our Hadoop-based data processing and analytics solutions while leveraging Java and Kafka for efficient data ingestion and processing.
Responsibilities:
Hadoop Development:
Design, develop, and maintain Hadoop-based data processing applications, workflows, and pipelines
Java Integration:
Utilize Java to build and enhance data processing components and services within the Hadoop ecosystem
Kafka Integration:
Implement Kafka-based data ingestion and streaming solutions to efficiently handle real-time data
Big Data Processing:
Leverage Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and HBase for batch and real-time data processing
Data Ingestion:
Develop and optimize data ingestion processes, ensuring data is collected, transformed, and loaded into the Hadoop cluster efficiently
Performance Optimization:
Monitor and optimize the performance of Hadoop jobs and data pipelines to ensure scalability and efficiency
Data Transformation:
Transform and prepare data for analysis, ensuring data quality, integrity, and compatibility with downstream applications
Kafka Streaming:
Design and implement Kafka-based data streaming solutions, handling large volumes of real-time data
Troubleshooting:
Identify and resolve data processing and Kafka-related issues in a timely manner
Collaboration:
Work closely with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver effective solutions
Documentation:
Create and maintain comprehensive documentation of Hadoop configurations, Java code, Kafka setups, and data processing workflows
Security:
Implement and maintain security measures to protect sensitive data within the Hadoop ecosystem and Kafka clusters.
RequirementsBachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Key skills required:
Java, Hadoop, Spark, Kafka, SQL, ETL tools, good to have cloud knowledgeProven experience as a Hadoop Developer with strong Java and Kafka skills.
Proficiency in Java programming for building data processing applications.Hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Spark, Hive, HBase).Familiarity with Kafka for data streaming and ingestion.
Strong knowledge of data transformation and ETL processes.
Excellent problem-solving skills and attention to detail.
Effective communication skills to collaborate with team members and stakeholders.
Experience with data security and compliance is a plus.
Ability to work in a fast-paced, dynamic environment and adapt to changing technologies and project requirements.
-
Hadoop Developer
2 weeks ago
Hyderabad, Telangana, India Virtual Labs Inc. Full timeJob Title: Sr Hadoop DeveloperLocation: Hyderabad, India (Hybrid)Experience: 4 to 8 yrs.•Hands on exp Hadoop, SQL, PY Spark and HDFSClient is looking for a candidate who is more proficient in Hadoop development with some testing experience
-
Hadoop Developer
2 weeks ago
Hyderabad, Telangana, India Nisum Full timeJob Brief A Hadoop Developer helps build large-scale data storage and processing software and infrastructure. Knowledge of existing tools is essential, as is the capacity to write software using the Hadoop API. What You'll Do Write software to interact with HDFS and MapReduce. Assess requirements and evaluate existing solutions. Build, operate,...
-
Hadoop developer
2 weeks ago
Hyderabad, Telangana, India Anicalls (Pty) Ltd Full timeStrong conceptual understanding of the context and business requirements. To understand the business needs, High-Level design, and produce Low-level design documents, implement code by the best practices. Hadoop development and Implementation. Loading from disparate data sets. Pre-processing using hive Ability to perform data quality checks in an orderly...
-
Hadoop Developer
2 weeks ago
Hyderabad, Telangana, India Hirexa Solutions Full timeHadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities : Interact with business stake holders and designers to implement to understand business requirements. Hadoop development and implementation. Loading from disparate data sets. Good to have Teradata Knowledge...
-
Software Developer/Java Spark
2 weeks ago
Hyderabad, Telangana, India Corporate Resources Full timeJob Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop, Hive, Control-M Secondary Skills, Unix, AWS Cloud, GIT,...
-
Spark and Java Developer
2 weeks ago
Hyderabad, Telangana, India Unison Consulting Full timeExperienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data program Requirements 5+ years of progressive experience in development with...
-
Hadoop Developer
2 months ago
Hyderabad, Telangana, India Hirexa Solutions Full timeHadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...
-
Java Developer
2 weeks ago
Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full timeJava Developer Job at XYZ CompanyResponsibilities : Develop and optimize Java code for our Trino (or Presto) platform. Show strong Java programming skills with an emphasis on objectoriented programming (OOP) principles. Analyze opensource code like Trino effectively. Enhance current Trino codebase and identify areas for improvement. Advantageous to have...
-
Java Developer
2 weeks ago
Hyderabad, Telangana, India Anblicks Full timeJOB Description Role: "Java Developer" (Microservices) Experience: 5 to 9 Yrs Location: Hyderabad or Ahmedabad Technical Experience Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP Java development experience working with integrations, transformations, and data migration projects with Spring boot . experience in developing microservices...
-
Hadoop Tester
2 weeks ago
Hyderabad, Telangana, India CGI Full timePosition Description: Company Profile: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global...
-
Hadoop Tester
2 weeks ago
Hyderabad, Telangana, India ValueMomentum Full timeJob Summary:Are you passionate about delivering quality software product through in-depth testing of software codes and products?We are looking for a Hadoop Testing Engineer who will be responsible for testing products or systems to ensure it functions properly and meets the business needs. Your job responsibilities include testing all aspects of the...
-
Java Developer
2 weeks ago
Hyderabad, Telangana, India HR Aspiration Full timeJob Description : Design, develop, test, and deploy efficient and maintainable Java applications using object-oriented programming principles and best practices. Collaborate with designers, product managers, and other engineers to understand and translate business requirements into technical solutions. Work collaboratively in a team environment to...
-
Java Developer
2 weeks ago
Hyderabad, Telangana, India Vastika IT Solutions Private Limited Full timeJoin Our Team as a Java Developer in HyderabadAre you a seasoned Java developer with 4-8 years of hands-on experience, specializing in Java 8 and above? If you're passionate about crafting robust and efficient code, we have an exciting opportunity for you to join our dynamic team in Hyderabad.Position : Java DeveloperExperience : 4-6 yearsLocation :...
-
Hadoop Tester
2 weeks ago
Hyderabad, Telangana, India CGI Full timePosition Description:Company Profile:At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources,...
-
Java Spark engineer
2 weeks ago
Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time10+ years experience in software development using Core Java and 5+ years experience in technologies (Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL) Advanced SQL capabilities are required. Good Knowledge of database design techniques and experience working with huge data volumes is a plus. Experience in Agile SDLC, JIRA, BitBucket/Git, AWS ECS,...
-
Java Spark
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeJava Spark - CREQ189587 DescriptionSkill- Java SparkExperience: 6-9 yrsRole: T2Responsibilities:5-7 Experience in Java development with Bigdata in Apache Spark, Hive, etcMust have exposure on big data bases /Data modelling design and developmentHandled end to end project delivery SDLC exposureDesign develop, implement, configure and document current and...
-
Java,Payment domain
2 weeks ago
Hyderabad, Telangana, India CGI Full timePosition Description: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise,...
-
Big data spark developer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeBig data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary...
-
Big data spark developer
2 weeks ago
Hyderabad, Telangana, India Virtusa Full timeBig data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...
-
Java Developer
2 months ago
Hyderabad/Telangana, Telangana, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities :- Develop and implement efficient Java code to optimize and enhance functionalities within our Trino (or Presto) platform.- Demonstrate excellent understanding of Java programming language and object-oriented programming (OOP) principles.- Possess strong code comprehension skills to effectively read and analyze open-source code like Trino.-...