
Lead Apache Hadoop Engineer
3 weeks ago
Lead Apache Hadoop Engineer
Position Overview
Job Title: Lead Apache Hadoop Engineer
Location: Pune, India
Corporate Title: Vice President
Role Description
- Technology serves as the foundation of our entire organization. Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure.
- We are committed to investing in and developing a team of forward-thinking technology professionals, offering them the training, autonomy, and opportunities necessary to engage in groundbreaking work. As a Lead Engineer, you will oversee the comprehensive delivery of engineering solutions to meet business objectives.
- You will have deep expertise in Hadoop ecosystem administration, scripting, and managing complex, large-scale migration projects. You will provide engineering leadership across various teams, mentor junior engineers, and promote ongoing enhancements in delivery methodologies.
- You will have the opportunity to collaborate closely with clients while being part of a larger, creative, and innovative team dedicated to making a significant impact.
- In RiskFinder, you will join a local team, collaborating with other teams both in your area and in different geographical locations.
- You will have the chance to architect, design, and implement an open-source big data platform, enabling clients to produce, access, and analyze extensive datasets through our custom components and applications.
What we'll offer you
As part of our flexible scheme, here are just some of the benefits that you'll enjoy
- Best in class leave policy
- Gender neutral parental leaves
- 100% reimbursement under childcare assistance benefit (gender neutral)
- Sponsorship for Industry relevant certifications and education
- Employee Assistance Program for you and your family members
- Comprehensive Hospitalization Insurance for you and your dependents
- Accident and Term life Insurance
- Complementary Health screening for 35 yrs. and above
Your key responsibilities
- Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem
- Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments.
- Develop and execute migration scripts, workflows and automation tools to streamline the transition process.
- Read, understand, and modify open-source code to implement bug fixes and perform upgrades.
- Security Architecture: Ensure all solutions adhere to security best practices and compliance requirements.
- Mitigate risks by identifying potential challenges (e.g., data loss, compatibility issues) and implementing contingency plans.
- Work directly with the Lead Architect and support cross-functional teams globally.
- Strategy Development: Contribute to defining the end-to-end platform engineering and application migration strategy.
Your skills and experience
- Proven experience in architecting, designing, building, and deploying big data platforms and applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios.
- Experience with hybrid cloud big data platform designs and deployments, especially in AWS, Azure, or GCP.
- Experience in large-scale data platform builds and application migrations. Expert knowledge of Apache Hadoop ecosystem and associated Apache projects (e.g., HDFS, Hive, HBase, Spark, Kafka, Yarn etc.).
- Proficiency in Kubernetes for container orchestration.
- Ability to read and modify open-source code.
- Experience with version upgrades of technology stacks.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills to work effectively with global teams.
- Ability to work independently and take initiative.
- Contributions to open-source projects.
How we'll support you
- Training and development to help you excel in your career
- Coaching and support from experts in your team
- A culture of continuous learning to aid progression
- A range of flexible benefits that you can tailor to suit your needs
About us and our teams
Please visit our company website for further information:
We strive for a in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.
Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.
We welcome applications from all people and promote a positive, fair and inclusive work environment.
-
BigData-Hadoop/Scala Engineer. AS
3 weeks ago
Pune, Maharashtra, India Deutsche Bank Full timeJob DescriptionBigData-Hadoop/Scala Engineer. ASPosition OverviewJob Title :BigData-Hadoop/Scala EngineerLocation : Pune, IndiaRole DescriptionAn Associate Engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the Bank. Root cause...
-
BigData-Hadoop/Scala Engineer, AVP
3 weeks ago
Pune, Maharashtra, India Deutsche Bank Full timeJob DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...
-
BigData-Hadoop/Scala Engineer, AVP
2 weeks ago
Pune, Maharashtra, India Deutsche Bank Full time ₹ 1,04,000 - ₹ 1,30,878 per yearBigData-Hadoop/Scala Engineer, AVPJob ID: R0388873Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key...
-
Pune, Maharashtra, India HSBC Full timeJob description ome careers shine brighter than others If you re looking for a career that will help you stand out join HSBC and fulfil your potential Whether you want a career that could take you to the top or simply take you in an exciting new direction HSBC offers opportunities support and rewards that will take you further HSBC is one of the...
-
Hadoop Senior Reliability Engineer
2 weeks ago
Pune, Maharashtra, India Citi Full time ₹ 1,04,000 - ₹ 1,30,878 per yearThe Engineering Lead Analyst is a senior level position responsible for leading a variety of engineering activities including the design, acquisition and deployment of hardware, software and network infrastructure in coordination with the Technology team. The overall objective of this role is to lead efforts to ensure quality standards are being met within...
-
Hadoop Data Engineer/ Consultant Specialist
3 weeks ago
Pune, Maharashtra, India HSBC Full timeJob DescriptionJob descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one...
-
Hadoop Admin
1 week ago
Pune, Maharashtra, India Kyndryl Full time ₹ 8,00,000 - ₹ 12,00,000 per yearWho We AreAt Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.The RoleAs a...
-
Lead Software Engineer
2 weeks ago
Pune, Maharashtra, India Mastercard Full time ₹ 12,00,000 - ₹ 36,00,000 per yearOverview Are you a passionate software engineer looking to take on a leadership role in a fast-paced environment? Do you thrive on solving complex problems and driving technical excellence? This is a great opportunity to join the team behind Crypto Secure, a powerful risk assessment tool that helps banks gain greater visibility of crypto spend,...
-
Sr Data Engineer
4 weeks ago
Pune, Maharashtra, India PHOTON Full timeJob Description- Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation.- Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions.- Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler.- Integrate DolphinScheduler with big data tools such...
-
High-Performance Data Engineering Specialist
2 weeks ago
Pune, Maharashtra, India beBeeBigDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000Big Data Engineer RoleWe are looking for a skilled Big Data Engineer to join our team. In this role, you will be responsible for designing and implementing big data solutions using cutting-edge technologies.Key ResponsibilitiesDistributed Computing Expertise: You will have an expert-level understanding of distributed computing principles and the ability to...