Hadoop Developer with Java

2 weeks ago


Hyderabad, Telangana, India Unison Consulting Pte Ltd Full time

Job Description:
We are seeking a skilled and experienced Hadoop Developer with expertise in Java and Kafka to join our team.

The ideal candidate will play a crucial role in designing, developing, and maintaining our Hadoop-based data processing and analytics solutions while leveraging Java and Kafka for efficient data ingestion and processing.


Responsibilities:

Hadoop Development:
Design, develop, and maintain Hadoop-based data processing applications, workflows, and pipelines

Java Integration:
Utilize Java to build and enhance data processing components and services within the Hadoop ecosystem

Kafka Integration:
Implement Kafka-based data ingestion and streaming solutions to efficiently handle real-time data

Big Data Processing:
Leverage Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and HBase for batch and real-time data processing

Data Ingestion:
Develop and optimize data ingestion processes, ensuring data is collected, transformed, and loaded into the Hadoop cluster efficiently

Performance Optimization:
Monitor and optimize the performance of Hadoop jobs and data pipelines to ensure scalability and efficiency

Data Transformation:
Transform and prepare data for analysis, ensuring data quality, integrity, and compatibility with downstream applications

Kafka Streaming:
Design and implement Kafka-based data streaming solutions, handling large volumes of real-time data

Troubleshooting:
Identify and resolve data processing and Kafka-related issues in a timely manner

Collaboration:
Work closely with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver effective solutions

Documentation:
Create and maintain comprehensive documentation of Hadoop configurations, Java code, Kafka setups, and data processing workflows

Security:
Implement and maintain security measures to protect sensitive data within the Hadoop ecosystem and Kafka clusters.
RequirementsBachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Key skills required:

Java, Hadoop, Spark, Kafka, SQL, ETL tools, good to have cloud knowledgeProven experience as a Hadoop Developer with strong Java and Kafka skills.

Proficiency in Java programming for building data processing applications.
Hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Spark, Hive, HBase).Familiarity with Kafka for data streaming and ingestion.
Strong knowledge of data transformation and ETL processes.
Excellent problem-solving skills and attention to detail.
Effective communication skills to collaborate with team members and stakeholders.
Experience with data security and compliance is a plus.
Ability to work in a fast-paced, dynamic environment and adapt to changing technologies and project requirements.
  • Hadoop Developer

    2 weeks ago


    Hyderabad, Telangana, India Virtual Labs Inc. Full time

    Job Title: Sr Hadoop DeveloperLocation: Hyderabad, India (Hybrid)Experience: 4 to 8 yrs.•Hands on exp Hadoop, SQL, PY Spark and HDFSClient is looking for a candidate who is more proficient in Hadoop development with some testing experience

  • Hadoop Developer

    2 weeks ago


    Hyderabad, Telangana, India Nisum Full time

    Job Brief A Hadoop Developer helps build large-scale data storage and processing software and infrastructure. Knowledge of existing tools is essential, as is the capacity to write software using the Hadoop API. What You'll Do Write software to interact with HDFS and MapReduce. Assess requirements and evaluate existing solutions. Build, operate,...

  • Hadoop developer

    2 weeks ago


    Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time

    Strong conceptual understanding of the context and business requirements. To understand the business needs, High-Level design, and produce Low-level design documents, implement code by the best practices. Hadoop development and Implementation. Loading from disparate data sets. Pre-processing using hive Ability to perform data quality checks in an orderly...

  • Hadoop Developer

    2 weeks ago


    Hyderabad, Telangana, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities : Interact with business stake holders and designers to implement to understand business requirements. Hadoop development and implementation. Loading from disparate data sets. Good to have Teradata Knowledge...


  • Hyderabad, Telangana, India Corporate Resources Full time

    Job Description 5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database ex.Oracle Extensive knowledge in HiveSQL Hadoop, SQL Experience in DevOps process (CICD, Jira, Bitbucket) Primary Skills, Spark with Java, Hadoop, Hive, Control-M Secondary Skills, Unix, AWS Cloud, GIT,...


  • Hyderabad, Telangana, India Unison Consulting Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data program Requirements 5+ years of progressive experience in development with...

  • Hadoop Developer

    2 months ago


    Hyderabad, Telangana, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...

  • Java Developer

    2 weeks ago


    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time

    Java Developer Job at XYZ CompanyResponsibilities : Develop and optimize Java code for our Trino (or Presto) platform. Show strong Java programming skills with an emphasis on objectoriented programming (OOP) principles. Analyze opensource code like Trino effectively. Enhance current Trino codebase and identify areas for improvement. Advantageous to have...

  • Java Developer

    2 weeks ago


    Hyderabad, Telangana, India Anblicks Full time

    JOB Description Role: "Java Developer" (Microservices) Experience: 5 to 9 Yrs Location: Hyderabad or Ahmedabad Technical Experience Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP Java development experience working with integrations, transformations, and data migration projects with Spring boot . experience in developing microservices...

  • Hadoop Tester

    2 weeks ago


    Hyderabad, Telangana, India CGI Full time

    Position Description: Company Profile: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global...

  • Hadoop Tester

    2 weeks ago


    Hyderabad, Telangana, India ValueMomentum Full time

    Job Summary:Are you passionate about delivering quality software product through in-depth testing of software codes and products?We are looking for a Hadoop Testing Engineer who will be responsible for testing products or systems to ensure it functions properly and meets the business needs. Your job responsibilities include testing all aspects of the...

  • Java Developer

    2 weeks ago


    Hyderabad, Telangana, India HR Aspiration Full time

    Job Description : Design, develop, test, and deploy efficient and maintainable Java applications using object-oriented programming principles and best practices. Collaborate with designers, product managers, and other engineers to understand and translate business requirements into technical solutions. Work collaboratively in a team environment to...

  • Java Developer

    2 weeks ago


    Hyderabad, Telangana, India Vastika IT Solutions Private Limited Full time

    Join Our Team as a Java Developer in HyderabadAre you a seasoned Java developer with 4-8 years of hands-on experience, specializing in Java 8 and above? If you're passionate about crafting robust and efficient code, we have an exciting opportunity for you to join our dynamic team in Hyderabad.Position : Java DeveloperExperience : 4-6 yearsLocation :...

  • Hadoop Tester

    2 weeks ago


    Hyderabad, Telangana, India CGI Full time

    Position Description:Company Profile:At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources,...

  • Java Spark engineer

    2 weeks ago


    Hyderabad, Telangana, India Anicalls (Pty) Ltd Full time

    10+ years experience in software development using Core Java and 5+ years experience in technologies (Hadoop, Spark, and Big Data platforms, RBDMS, NoSQL) Advanced SQL capabilities are required. Good Knowledge of database design techniques and experience working with huge data volumes is a plus. Experience in Agile SDLC, JIRA, BitBucket/Git, AWS ECS,...

  • Java Spark

    2 weeks ago


    Hyderabad, Telangana, India Virtusa Full time

    Java Spark - CREQ189587 DescriptionSkill- Java SparkExperience: 6-9 yrsRole: T2Responsibilities:5-7 Experience in Java development with Bigdata in Apache Spark, Hive, etcMust have exposure on big data bases /Data modelling design and developmentHandled end to end project delivery SDLC exposureDesign develop, implement, configure and document current and...

  • Java,Payment domain

    2 weeks ago


    Hyderabad, Telangana, India CGI Full time

    Position Description: At CGI, we're a team of builders. We call our employees members because all who join CGI are building their own company - one that has grown to 72, professionals located in 40 countries. Founded in , CGI is a leading IT and business process services firm committed to helping clients succeed. We have the global resources, expertise,...


  • Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary...


  • Hyderabad, Telangana, India Virtusa Full time

    Big data spark developer - CREQ180562 Description Essential:5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket) Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced...

  • Java Developer

    2 months ago


    Hyderabad/Telangana, Telangana, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities :- Develop and implement efficient Java code to optimize and enhance functionalities within our Trino (or Presto) platform.- Demonstrate excellent understanding of Java programming language and object-oriented programming (OOP) principles.- Possess strong code comprehension skills to effectively read and analyze open-source code like Trino.-...