
Hadoop,Spark Data Engineer/Consultant Specialist
3 weeks ago
Job description
Some careers shine brighter than others.
If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Senior Consultant Specialist
In this role will be responsible for the below:
- The Senior Data Engineer will be responsible for designing, building, and managing the data infrastructure and data pipeline processes for the bank. This role involves leading a team of data engineers, working closely with data scientists, analysts, and IT professionals to ensure data is accessible, reliable, and secure. The ideal candidate will have a strong background in data engineering, excellent leadership skills, and a thorough understanding of the banking industry's data requirements.
- Leadership and Team Management .Lead, mentor, and develop a team of data engineers.
- Establish best practices for data engineering and ensure team adherence.
- Coordinate with other IT teams, business units, and stakeholders.
- Data Pipelines Integration and Management:
- Design and implement scalable data architectures to support the bank's data needs.
- Develop and maintain ETL (Extract, Transform, Load) processes.
- Ensure the data infrastructure is reliable, scalable, and secure.
- Oversee the integration of diverse data sources into a cohesive data platform.
- Ensure data quality, data governance, and compliance with regulatory requirements.
- Develop and enforce data security policies and procedures.
- Monitor and optimize data pipeline performance.
- Troubleshoot and resolve data-related issues promptly.
- Implement monitoring and alerting systems for data processes
Requirements
To be successful in this role, you should meet the following requirements:(Must have Requirements)
- 8+ years of experience in data engineering or related field
- Strong experience with database technologies (SQL, NoSQL), data warehousing solutions, and big data technologies (Hadoop, Spark)
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with cloud platforms (AWS, Azure, Google Cloud) and their data services.
- Deep understanding of ETL processes and data pipeline orchestration tools (Airflow, Apache NiFi).
- Knowledge of data modeling, data warehousing concepts, and data integration techniques.
- Strong problem-solving skills and ability to work under pressure.
- Excellent communication and interpersonal skills.
- Experience in the banking or financial services industry.
- Familiarity with regulatory requirements related to data security and privacy in the banking sector.
- Certifications in cloud platforms (AWS Certified Data Analytics, Google Professional Data Engineer, etc.).
- Experience with machine learning and data science frameworks
Location : Pune and Bangalore
You'll achieve more when you join HSBC.
www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by - HSBC Software Development India
-
Hadoop Data Engineer/ Consultant Specialist
3 weeks ago
Pune, Maharashtra, India HSBC Full timeJob DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...
-
Hadoop Admin/Consultant Specialist
4 weeks ago
Pune, Maharashtra, India HSBC Full timeJob DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...
-
Pune, Maharashtra, India HSBC Full timeJob DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...
-
Hadoop Administrator
3 weeks ago
Pune, Maharashtra, India LIFTU TECHNOLOGY PRIVATE LIMITED Full timeJob Summary : We are looking for an experienced Hadoop Administrator with 4+ years of hands-on experience in managing and supporting Hadoop ecosystems. The ideal candidate will have deep expertise in Unix-based system administration, Cloudera and Hortonworks distributions, and configuring secure and highly available Hadoop clusters in both on-premise and...
-
Hadoop Developer
3 weeks ago
Pune, Maharashtra, India virtusa Full timeHadoop developer JD Ability to build data models data lineage metadata APIs using Hadoop technologies Programming experience in Python JAVA or Scala is nice to have Hands on experience in Python3 for building services and REST APIs on the backend for web applications Familiarity with UI development would be preferred ReactJs Experience in building...
-
Data Engineer
2 days ago
Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Hadoop Data Engineer/Senior Software Engineer
2 weeks ago
Pune, Maharashtra, India HSBC Full time ₹ 15,00,000 - ₹ 28,00,000 per yearJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...
-
Sr Data Engineer
4 weeks ago
Pune, Maharashtra, India PHOTON Full timeJob Description- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.- Integrate DolphinScheduler with big data tools such...
-
Hadoop Admin
1 week ago
Pune, Maharashtra, India Kyndryl Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWho We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The RoleAs a...
-
Hadoop Administrator
2 weeks ago
Pune, Maharashtra, India Consulting Pandits Full timeExperience : 4 to 7 YearsLocation : Pune (work from office)Job Description : - 4+ years of hands-on experience - Hadoop, System administration with sound knowledge in Unix based Operating System internals.- Working experience on Cloudera CDP and CDH and Hortonworks HDP Distribution.- Linux experience (RedHat, CentOS, Ubuntu).- Experience in setting up and...