Hadoop Data Engineer/Software Engineer

2 weeks ago

Bengaluru, Karnataka, India HSBC Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job description

Some careers shine brighter than others.

If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Software Engineer

In this role, you will:

  • Software design, Scala & Spark development, automated testing of new and existing components in an Agile, DevOps and dynamic environment
  • Promoting development standards, code reviews, mentoring, knowledge sharing
  • Production support & troubleshooting.
  • Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring
  • Liaison with BAs to ensure that requirements are correctly interpreted and implemented.
  • Participation in regular planning and status meetings. Input to the development process – through the involvement in Sprint reviews and retrospectives. Input into system architecture and design.
  • Peer code reviews.

Requirements

To be successful in this role, you should meet the following requirements:

  • Scala development and design using Scala 2.10+ or Java development and design using Java 1.8+.
  • Experience with most of the following technologies (Apache Hadoop, Scala, Apache Spark, Spark streaming, YARN, Kafka, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services).
  • Sound knowledge on working Unix/Linux Platform
  • Hands-on experience building data pipelines using Hadoop components - Hive, Spark, Spark SQL.
  • Experience with industry standard version control tools (Git, GitHub), automated deployment tools (Ansible & Jenkins) and requirement management in JIRA.
  • Understanding of big data modelling techniques using relational and non-relational techniques
  • Experience on Debugging the Code issues and then publishing the highlighted differences to the development team/Architects;
  • Experience with time-series/analytics dB's such as Elastic search.
  • Experience with scheduling tools such as Airflow, Control-M.
  • Understanding or experience of Cloud design patterns
  • Exposure to DevOps & Agile Project methodology such as Scrum and Kanban.
  • Experience with developing Hive QL, UDF's for analysing semi structured/structured datasets.

You'll achieve more when you join HSBC.

HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.

Issued by – HSDI

  • Data Entry Operator

    2 weeks ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Hadoop Support Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Amiseq Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Hadoop Support EngineerBengaluru, KA - WFOWe are seeking a dedicated Hadoop Support Engineer to provide comprehensive support and on-call services for our Hadoop infrastructure. This role is pivotal in ensuring the continuous operation and stability of our Hadoop clusters, addressing incidents promptly, and supporting end-users with technical queries. The...

  • Hadoop support Engineer

    1 day ago

    Bengaluru, Karnataka, India AMISEQ Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job DescriptionRole:- Hadoop Support engineerClient: eBayLocation: Bangalore (Hybrid)We are seeking a dedicated Hadoop Support Engineer to provide comprehensive support and on-call services for our Hadoop infrastructure. This role is pivotal in ensuring the continuous operation and stability of our Hadoop clusters, addressing incidents promptly, and...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Axiom Software Solutions Limited Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Data Engineer - TCSCompany: Axiom Software Solutions LimitedType: PermanentLocation: United KingdomJob Description:Axiom Software Solutions Limited is seeking a skilled Data Engineer to join our team in a permanent capacity. The ideal candidate will have significant experience in building scalable data pipelines and contributing to data management...

  • Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Lowe s Full time

    Job Description- Bachelors Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)- 2 years of experience in Data, Platform Engineering, Data Warehousing/ETL, Cloud Platform or Software Engineering- 1 year of experience working on project(s) involving the implementation of solutions applying...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Applore Technologies Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for a forward-thinking Data & AI Engineer with 1– 6 years of experience in data engineering and a passion for using modern AI tools to accelerate development workflows. The ideal candidate is proficient in Python, SQL, PySpark, and has experience working in on-premise big data environments (e.g., Spark, Hadoop, Hive, HDFS). This role is...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Blend Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Company DescriptionBlend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Clover Infotech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description:Position: Data EngineerLocation: BangaloreExp: 6 to 15 yrsSkills required:Having good development and design experience as Data Engineer.Strong experience in PySpark, Spark, Python, Hadoop eco-system.Experience on Big Data platforms and distributed computing (e.g. Hadoop, Map/Reduce, Spark, HBase, Hive).Experience in data pipeline software...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Blend360 Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company Description Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...

  • Senior Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Okta Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    About the PositionThis is an opportunity for experienced Software Engineers to join our fast growing Data Platform organization that is passionate about scaling high volume, low-latency, distributed data-platform services & data products. In this role, you will get to work with engineers throughout the organization to build foundational infrastructure that...