Hadoop Developer with Java

1 month ago

hyderabad, India Unison Consulting Pte Ltd Full time

Job Description:

We are seeking a skilled and experienced Hadoop Developer with expertise in Java and Kafka to join our team. The ideal candidate will play a crucial role in designing, developing, and maintaining our Hadoop-based data processing and analytics solutions while leveraging Java and Kafka for efficient data ingestion and processing.

Responsibilities:

  • Hadoop Development: Design, develop, and maintain Hadoop-based data processing applications, workflows, and pipelines.
  • Java Integration: Utilize Java to build and enhance data processing components and services within the Hadoop ecosystem.
  • Kafka Integration: Implement Kafka-based data ingestion and streaming solutions to efficiently handle real-time data.
  • Big Data Processing: Leverage Hadoop technologies such as HDFS, MapReduce, Spark, Hive, and HBase for batch and real-time data processing.
  • Data Ingestion: Develop and optimize data ingestion processes, ensuring data is collected, transformed, and loaded into the Hadoop cluster efficiently.
  • Performance Optimization: Monitor and optimize the performance of Hadoop jobs and data pipelines to ensure scalability and efficiency.
  • Data Transformation: Transform and prepare data for analysis, ensuring data quality, integrity, and compatibility with downstream applications.
  • Kafka Streaming: Design and implement Kafka-based data streaming solutions, handling large volumes of real-time data.
  • Troubleshooting: Identify and resolve data processing and Kafka-related issues in a timely manner.
  • Collaboration: Work closely with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver effective solutions.
  • Documentation: Create and maintain comprehensive documentation of Hadoop configurations, Java code, Kafka setups, and data processing workflows.
  • Security: Implement and maintain security measures to protect sensitive data within the Hadoop ecosystem and Kafka clusters.

Requirements

  • Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
  • Key skills required: Java, Hadoop, Spark, Kafka, SQL, ETL tools, good to have cloud knowledge
  • Proven experience as a Hadoop Developer with strong Java and Kafka skills.
  • Proficiency in Java programming for building data processing applications.
  • Hands-on experience with Hadoop ecosystem components (HDFS, MapReduce, Spark, Hive, HBase).
  • Familiarity with Kafka for data streaming and ingestion.
  • Strong knowledge of data transformation and ETL processes.
  • Excellent problem-solving skills and attention to detail.
  • Effective communication skills to collaborate with team members and stakeholders.
  • Experience with data security and compliance is a plus.
  • Ability to work in a fast-paced, dynamic environment and adapt to changing technologies and project requirements.

  • Hadoop Developer with Java

    4 weeks ago

    Hyderabad, India Unison Consulting Pte Ltd Full time

    Job Description:We are seeking a skilled and experienced Hadoop Developer with expertise in Java and Kafka to join our team. The ideal candidate will play a crucial role in designing, developing, and maintaining our Hadoop-based data processing and analytics solutions while leveraging Java and Kafka for efficient data ingestion and...

  • Hadoop Developer with Java

    1 month ago

    Hyderabad, India Unison Consulting Pte Ltd Full time

    Job Description: We are seeking a skilled and experienced Hadoop Developer with expertise in Java and Kafka to join our team. The ideal candidate will play a crucial role in designing, developing, and maintaining our Hadoop-based data processing and analytics solutions while leveraging Java and Kafka for efficient data ingestion and processing. ...

  • Java spark developer

    2 weeks ago

    hyderabad, India Virtusa Full time

    Java spark developer - CREQ188182 Description Position: Java spark developer primary skills: Java , spark, big data Location: Hyd & BLR 8+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExpereience in DevOps process (CICD, Jira,...

  • Java spark developer

    2 weeks ago

    Hyderabad, India Virtusa Full time

    Java spark developer - CREQ188182 Description Position: Java spark developer primary skills: Java , spark, big data Location: Hyd & BLR 8+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive) Experience in writing SQL for any one relation database Extensive knowledge in HiveSQL Hadoop, SQL Expereience in DevOps process (CICD, Jira,...

  • Java spark developer

    7 days ago

    Hyderabad, India Virtusa Full time

    Java spark developer - CREQ188182 DescriptionPosition: Java spark developerprimary skills: Java , spark, big dataLocation: Hyd & BLR8+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation databaseExtensive knowledge in HiveSQL Hadoop, SQLExpereience in DevOps process (CICD, Jira,...

  • Senior Hadoop developer

    4 weeks ago

    Hyderabad, India Tech Tammina Full time

    Role: Hadoop developerLocation: Hyderabad/ VizagDuration: FTE with TechTamminaRequirements:Bachelor s degree in software engineering or computer science.Previous experience as a hadoop developer or big data engineer.Advanced knowledge of the hadoop ecosystem and its components.In-depth knowledge of Hive, HBase, and Pig.Familiarity with MapReduce and Pig...

  • Java Developer

    6 days ago

    Hyderabad, India Anblicks Full time

    JOB DescriptionRole:"Java Developer" (Microservices)Experience: 5 to 9 YrsLocation:Hyderabad or AhmedabadTechnical Experience- Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP- Java development experience working with integrations, transformations, and data migration projects withSpring boot .- experience in developingmicroservices and...

  • Java Developer

    6 days ago

    hyderabad, India Anblicks Full time

    JOB DescriptionRole: "Java Developer" (Microservices)Experience: 5 to 9 YrsLocation: Hyderabad or AhmedabadTechnical Experience- Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP- Java development experience working with integrations, transformations, and data migration projects with Spring boot .- experience in developing microservices...

  • Software Developer/Java Spark

    4 weeks ago

    Hyderabad, India Corporate Resources Full time

    Job Description5 years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)Experience in writing SQL for any one relation database ex.OracleExtensive knowledge in HiveSQL Hadoop, SQLExperience in DevOps process (CICD, Jira, Bitbucket)Primary Skills, Spark with Java, Hadoop, Hive, Control-MSecondary Skills, Unix, AWS Cloud, GIT, Jira,Good to...

  • Hadoop Developer

    3 weeks ago

    Hyderabad, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...

  • Hadoop Developer

    3 weeks ago

    Hyderabad, Telangana, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...

  • Hadoop Developer

    2 weeks ago

    Hyderabad, India Hirexa Solutions Full time

    Hadoop/Omnia Dev Engineers To develop and deliver codes for the work assigned in accordance with time| quality and cost standardsJob responsibilities :- Interact with business stake holders and designers to implement to understand business requirements.- Hadoop development and implementation.- Loading from disparate data sets.- Good to have Teradata...

  • Spark and Java Developer

    4 weeks ago

    Hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...

  • Spark and Java Developer

    1 month ago

    Hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data programRequirements• 5+ years of progressive experience in development...

  • Spark and Java Developer

    1 month ago

    hyderabad, India Unison Consulting Pte Ltd Full time

    Experienced Apache Spark & Java developer will be responsible for supporting and enhancing enterprise wide data platform. In this role, you will be not only be designing and coding, but also collaborating with team members to help support core capabilities in the enterprise wide data program Requirements • 5+ years of progressive experience in development...

  • Java Developer

    6 days ago

    Hyderabad, India Anblicks Full time

    JOB DescriptionRole: "Java Developer" (Microservices) Experience: 5 to 9 YrsLocation: Hyderabad or AhmedabadTechnical Experience- Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP- Java development experience working with integrations, transformations, and data migration projects with Spring boot.- experience in developing microservices and...

  • Java Developer

    7 days ago

    Hyderabad, India Anblicks Full time

    JOB DescriptionRole: "Java Developer" (Microservices) Experience: 5 to 9 YrsLocation: Hyderabad or AhmedabadTechnical Experience- Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP- Java development experience working with integrations, transformations, and data migration projects with Spring boot.- experience in developing microservices and...

  • Java Developer

    6 days ago

    Hyderabad, India Anblicks Full time

    JOB Description Role: "Java Developer" (Microservices) Experience: 5 to 9 Yrs Location: Hyderabad or Ahmedabad Technical Experience - Need experience in JAVA, Spring boot, Rest API, JSON, XML, and SOAP - Java development experience working with integrations, transformations, and data migration projects with Spring boot . - experience in developing...

  • Software Development Engineer

    1 month ago

    Hyderabad, India Talentxo Full time

    Job Description :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment- 3+ Years of track record of...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, India TalentXo Full time

    Role & Responsibilities :Good development practices :- Hands on coder with good experience in programming languages like Java or Python.- Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.- Good understanding of programming principles and development practices like checkin policy, unit testing, code...