Unison Consulting

3 weeks ago

Bangalore, India Unison consulting pte ltd Full time

We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure.

You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics needs.

Responsibilities :

- Design, develop, and maintain big data processing applications, workflows, and pipelines using Hadoop technologies.

- Utilize Java to build and enhance data processing components and services within the Hadoop ecosystem.

- Implement Kafka-based data ingestion and streaming solutions to efficiently manage real-time data flows.

- Leverage Hadoop technologies (HDFS, MapReduce, Spark, Hive, HBase) for batch and real-time data processing tasks.

- Develop and optimize data ingestion processes to ensure efficient data collection, transformation, and loading into the Hadoop cluster.

- Monitor and optimize the performance of Hadoop jobs and data pipelines for scalability and efficiency.

- Clean and transform data for analysis, ensuring data quality, integrity, and compatibility with downstream applications.

- Design and implement Kafka-based streaming solutions to handle large volumes of real-time data.

- Troubleshoot data processing and Kafka-related issues promptly.

- Collaborate effectively with data engineers, data scientists, and other cross-functional teams to understand data requirements and deliver successful solutions.

- Create and maintain comprehensive documentation of Hadoop configurations, Java code, Kafka setups, and data processing workflows.

- Implement and maintain security measures to safeguard sensitive data within the Hadoop ecosystem and Kafka Bachelor's or Master's degree in Computer Science, Information Technology, or a related field (preferred).

- Proven experience as a Hadoop Developer with strong Java and Kafka skills.

- Proficiency in Java programming for building data processing applications.

- Hands-on experience with core Hadoop ecosystem components (HDFS, MapReduce, Spark, Hive, HBase).

- Familiarity with Kafka for data streaming and ingestion.

- Strong understanding of data transformation and ETL processes.

- Excellent problem-solving skills and a keen eye for detail.

- Effective communication skills for collaboration with team members and stakeholders.

- Experience with data security and compliance is a plus.

- Ability to thrive in a fast-paced environment and adapt to evolving technologies and project requirements.

(ref:hirist.tech)

  • DBT + Airflow

    1 month ago

    bangalore, India Unison Consulting Pte Ltd Full time

    Unison Consulting Pte Ltd is a leading consulting firm in the banking industry. We are currently seeking a talented individual to join our team as a DBT + Airflow. In this role, you will be responsible for managing and optimizing the data transformation and workflow processes for our banking clients. This is a unique opportunity for someone experienced in...

  • Unison Consulting

    2 weeks ago

    bangalore, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    3 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    Business Analyst - Treasury Domain (FX/MM/SE) About the Role:We are seeking a highly motivated and analytical Business Analyst to join our team. You will play a key role in the Software Development Life Cycle (SDLC) by bridging the gap between business stakeholders and the development team. Your responsibilities will encompass gathering requirements,...

  • Unison Consulting

    2 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    Business Analyst - Treasury Domain (FX/MM/SE) About the Role:We are seeking a highly motivated and analytical Business Analyst to join our team. You will play a key role in the Software Development Life Cycle (SDLC) by bridging the gap between business stakeholders and the development team. Your responsibilities will encompass gathering requirements,...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    2 weeks ago

    bangalore, India Unison consulting pte ltd Full time

    Solution Architect We are seeking a highly skilled and experienced Solution Architect to join our dynamic team.As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements.Your expertise will bridge the gap between business needs and technical implementation,...

  • Unison Consulting

    2 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    About the job- Experience with supporting Java (J2EE/Spring Boot) based multi-tier applications with complex upstream downstream interactions having expertise in understanding the application request flow and analysing application logs for investigating and troubleshooting issues and application break- Ability to work in a dynamic environment with ability to...

  • Unison Consulting

    2 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    Solution Architect We are seeking a highly skilled and experienced Solution Architect to join our dynamic team.As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements.Your expertise will bridge the gap between business needs and technical implementation,...

  • Unison Consulting

    3 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    About the Role:We are seeking a highly skilled Senior Developer to join our growing team and play a key role in developing and maintaining critical applications used within the Financial Crimes Compliance (FCCM) or Anti-Money Laundering (AML) space. You will leverage your expertise in Java, JSP Servlets, and PL/SQL to design, develop, and implement robust...

  • Unison Consulting

    3 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    JOB DESCRIPTION: - Understand the product roadmap and ensure that testing is conducted as per the QA process. - Work closely with the test lead to devise test strategies for the applications/projects assigned. - Ensure that the test strategy is implemented as per plan. - Adhere to the QA process, frameworks, principles, and guidelines always. - Have good...

  • Unison Consulting

    2 weeks ago

    bangalore, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Unison Consulting

    2 weeks ago

    bangalore, India Unison consulting pte ltd Full time

    About the job- Experience with supporting Java (J2EE/Spring Boot) based multi-tier applications with complex upstream downstream interactions having expertise in understanding the application request flow and analysing application logs for investigating and troubleshooting issues and application break- Ability to work in a dynamic environment with ability to...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    We are seeking a talented Big Data Engineer to join our team and play a key role in designing, developing, and maintaining our big data infrastructure. You will leverage your expertise in Java, Hadoop, and Kafka to build efficient data pipelines, handle real-time data streams, and ensure high-quality data processing for our data analytics...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the job- Experience with supporting Java (J2EE/Spring Boot) based multi-tier applications with complex upstream downstream interactions having expertise in understanding the application request flow and analysing application logs for investigating and troubleshooting issues and application break- Ability to work in a dynamic environment with ability to...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    Solution Architect We are seeking a highly skilled and experienced Solution Architect to join our dynamic team.As a Solution Architect, you will play a crucial role in designing innovative and effective solutions that meet our clients' complex business requirements.Your expertise will bridge the gap between business needs and technical implementation,...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a highly skilled Senior Developer to join our growing team and play a key role in developing and maintaining critical applications used within the Financial Crimes Compliance (FCCM) or Anti-Money Laundering (AML) space. You will leverage your expertise in Java, JSP Servlets, and PL/SQL to design, develop, and implement robust...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    JOB DESCRIPTION: - Understand the product roadmap and ensure that testing is conducted as per the QA process. - Work closely with the test lead to devise test strategies for the applications/projects assigned. - Ensure that the test strategy is implemented as per plan. - Adhere to the QA process, frameworks, principles, and guidelines always. - Have good...

  • Unison Consulting

    3 weeks ago

    Bangalore, India Unison consulting pte ltd Full time

    About the Role :We are seeking a highly skilled SAS and Python developer to join our team and play a key role in building, maintaining, and enhancing data-driven solutions. You will leverage your expertise in both languages to create robust and scalable applications throughout the entire product development lifecycle, from planning and design to quality...

  • Unison Consulting

    3 weeks ago

    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role :We are seeking a highly skilled SAS and Python developer to join our team and play a key role in building, maintaining, and enhancing data-driven solutions. You will leverage your expertise in both languages to create robust and scalable applications throughout the entire product development lifecycle, from planning and design to quality...