Data Production Engineer

1 month ago


Mumbai, India BNP Paribas Personal Finance Full time

About BNP Paribas India Solutions:

Established in 2005, BNP Paribas India Solutions is a wholly owned subsidiary of BNP Paribas SA, European Union’s leading bank with an international reach. With delivery centers located in Bengaluru, Chennai and Mumbai, we are a 24x7 global delivery center. India Solutions services three business lines: Corporate and Institutional Banking, Investment Solutions and Retail Banking for BNP Paribas across the Group. Driving innovation and growth, we are harnessing the potential of over 10000 employees, to provide support and develop best-in-class solutions.

About BNP Paribas Group:

 BNP Paribas is the European Union’s leading bank and key player in international banking. It operates in 65 countries and has nearly 185,000 employees, including more than 145,000 in Europe. The Group has key positions in its three main fields of activity: Commercial, Personal Banking & Services for the Group’s commercial & personal banking and several specialised businesses including BNP Paribas Personal Finance and Arval; Investment & Protection Services for savings, investment, and protection solutions; and Corporate & Institutional Banking, focused on corporate and institutional clients. Based on its strong diversified and integrated model, the Group helps all its clients (individuals, community associations, entrepreneurs, SMEs, corporates and institutional clients) to realize their projects through solutions spanning financing, investment, savings and protection insurance. In Europe, BNP Paribas has four domestic markets: Belgium, France, Italy, and Luxembourg. The Group is rolling out its integrated commercial & personal banking model across several Mediterranean countries, Turkey, and Eastern Europe. As a key player in international banking, the Group has leading platforms and business lines in Europe, a strong presence in the Americas as well as a solid and fast-growing business in Asia-Pacific. BNP Paribas has implemented a Corporate Social Responsibility approach in all its activities, enabling it to contribute to the construction of a sustainable future, while ensuring the Group's performance and stability

Commitment to Diversity and Inclusion

At BNP Paribas, we passionately embrace diversity and are committed to fostering an inclusive workplace where all employees are valued, respected and can bring their authentic selves to work. We prohibit Discrimination and Harassment of any kind and our policies promote equal employment opportunity for all employees and applicants, irrespective of, but not limited to their gender, gender identity, sex, sexual orientation, ethnicity, race, colour, national origin, age, religion, social status, mental or physical disabilities, veteran status etc. As a global Bank, we truly believe that inclusion and diversity of our teams is key to our success in serving our clients and the communities we operate in.

About Business line/Function:

ITG Production (biggest IT department within ITG) has adapted its organization in 2020 in order to embrace the Digital and Cloud transformation operated by the group. A Data Division was created to help and reach this aim.

As a production engineer on the Hadoop HDP/CDP stack in the IT domain “DATAPLATFORMS” in the DATA division, you’ll be at the heart of the production teams. You’ll work on DATA topics for the business lines of the group and you’ll be responsible of installing, maintaining and supporting all their HDP/CDP clusters that allow their application to run efficiently.

You will work closely with the DATA Division located in France, and will have daily contacts with the DATAPLATFORMS manager, IT, OPS teams and editor support team (IBM/Cloudera)

Job Title:

Data Production ENGINEER HDP/CDP

Date:

April /2024

Department:

ITGP

Location:

Chennai

Business Line / Function:

DATAPLATFORMS – DAT06

Reports to:

(Direct)

Manager

Grade:

(if applicable)

(Functional)

Number of Direct Reports:

Directorship / Registration:

NA Position Purpose

As a production engineer on the Hadoop HDP/CDP stack in the IT domain “DATAPLATFORMS” in the DATA division, you’ll be at the heart of the production teams. You’ll work on DATA topics for the business lines of the group and you’ll be responsible of installing, maintaining and supporting all their HDP/CDP clusters that allow their application to run efficiently.

You will work closely with the DATA Division located in France, and will have daily contacts with the DATAPLATFORMS manager, IT, OPS teams and editor support team (IBM/Cloudera)

Responsibilities

Direct Responsibilities

·       Execute requested actions based on defined procedures and processes:

o   HDP/CDP Cluster Installation (DEV, TEST, STAGING, PROD)

o   Installation & configuration of the componants : Zookeeper, HDFS, Spark, Hive, Kerberos, Sentry, Anaconda, Hue, Kafka…

o   HDP/CDP clusters maintenance, patching & upgrade

o   Monitoring & Administration of HDP/CDP clusters (Ambari, Cloudera Manager, Ranger policies, ACLs)

o   Playbook development (knowledge of Ansible Tower required)

o   Ticket resolution (level 1, 2 & 3)  - with IBM/Cloudera support team

o   Cluster security

o   Grant accesses based on roles and with prior validation

o   Execute other technical actions

·       Coordinate above actions with other teams, especially Paris Data platforms team,  OPS & worldwide application development teams.

Contributing Responsibilities

·       Contribute to the knowledge transfer with Paris Dataplatforms team

·       Contribute to the definition of procedures and processes necessary for the team

·       Help build team spirit and integrate into BNP Paribas culture

·       Contribute to the regular activity reporting and KPI calculation

·       Contribute to continuous improvement actions

·     Contribute to the acquisition by ISPL team of new skills & knowledge to expand its scope Technical & Behavioral Competencies

·       HDP/CDP Cluster Installation (DEV, TEST, STAGING, PROD)

·       Installation & configuration of the componants : Zookeeper, HDFS, Spark, Hive, Kerberos, Sentry, Anaconda, Hue, Kafka…

·       HDP/CDP clusters maintenance, patching & upgrade

·       Monitoring & Administration of HDP/CDP clusters (Ambari, Cloudera Manager, Ranger policies, ACLs)

·       Playbook development (knowledge of Ansible Tower required)

·       Ticket resolution (level 1, 2 & 3)  - with IBM/Cloudera support team

·       Cluster security

·       Grant accesses based on roles and with prior validation

·       Execute other technical actions

·       General IT infrastructure knowledge

·       Knowledge of ITIL

·       Good knowledge on JIRA Confluence

·       Good knowledge on Service Now

·       Skilled on Agile methodology (Scrum & Kanban)

·       Particular knowledge and experience with RedHat Linux

·       Experience with system scripting

·       Experience with DevOps tooling DevOps (Gitlab, Artifactory, Jenkins, SonarQube, Mattermost, Ansible, …)

·        Knowledge of Autosys

·       Database technology is required: Oracle and SQL Server. Capability to execute basic scripts and queries

·       Good written and spoken English

·       Measure and identify areas for improving Quality and overall Delivery

·       Ability to to communicate efficiently

·       Good Team Player

Skills Referential

Behavioural Skills: (Please select up to 4 skills)

Ability to collaborate / Teamwork

Ability to deliver / Results driven

Creativity & Innovation / Problem solving

Ability to share / pass on knowledge

Transversal Skills: (Please select up to 5 skills)

Analytical Ability

Ability to understand, explain and support change

Ability to develop and adapt a process

Choose an item.

Choose an item.

Education Level:

Master Degree or equivalent

Experience Level

At least 3 years


  • Product Lead

    2 weeks ago


    Mumbai, India Yotta Data Services Private Limited Full time

    Job Scope:The AI Product Strategy Lead will spearhead the strategic direction and development of AI products within the organization's “X-as-a-service “model. This role will be pivotal in defining the product vision, driving innovation, and ensuring alignment with overarching business objectives.Job Responsibilities:Product Vision: Define the overarching...

  • Product Lead

    2 weeks ago


    Mumbai, India Yotta Data Services Private Limited Full time

    Job Scope:The AI Product Strategy Lead will spearhead the strategic direction and development of AI products within the organization's “X-as-a-service “model. This role will be pivotal in defining the product vision, driving innovation, and ensuring alignment with overarching business objectives.Job Responsibilities:Product Vision: Define the overarching...

  • Data Engineer

    3 weeks ago


    Mumbai, India Antal International Full time

    Job DescriptionData Engineer Job Responsibilities:· Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.· Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering...

  • Data Engineer

    3 weeks ago


    Mumbai, India Searce Technologies Inc Full time

    about the roleData Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions.key responsibilitiesAs a Data Engineer, you are a full-stack data engineer that...

  • Data Engineer

    4 weeks ago


    mumbai, India Antal International Full time

    Job Description Data Engineer Job Responsibilities: · Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. · Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    4 weeks ago


    Mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a full-stack...

  • Data Engineer

    4 weeks ago


    mumbai, India Searce Technologies Inc Full time

    about the role Data Engineer identifies the business problem and translates these to data services and engineering outcomes. You will deliver data solutions that empower better decision making and flexibility of your solution that scales to respond to broader business questions. key responsibilities As a Data Engineer, you are a...

  • Data Engineer

    5 days ago


    Mumbai, India Newfold Digital Full time

    Data EngineerJOB DESCRIPTIONNewfold Digital is looking for a seasoned Data Engineer. This role will participate in all aspects of the development lifecycle, from scoping and requirements to solutioning, implementation and support. The ideal candidate would have extensive experience developing and supporting a DW service comprised of multiple Data Warehouses...

  • Data Engineer

    3 weeks ago


    Mumbai, India Puma Energy Full time

    Main Purpose:Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    1 week ago


    mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer.Hands On programming experienceImplementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation.Experience of performance optimization in Batch and Real time processing applicationsExpertise in Data Governance and Data Security...

  • Data Engineer

    1 week ago


    Mumbai, India Virtusa Full time

    Data Engineer - CREQ187220 Description 6-8 years of relevant work experience showing growth as a Data Engineer. Hands On programming experience Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS LakeFormation. Experience of performance optimization in Batch and Real time processing applications Expertise in Data Governance and Data Security...

  • Data Engineer

    4 weeks ago


    mumbai, India Anicalls (Pty) Ltd Full time

    Candidate should have: Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborate Strong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud setting Understanding of ELK stack is a plus for logging and reporting purposes...

  • Data Engineer

    4 weeks ago


    Mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed...

  • Data Engineer

    4 weeks ago


    mumbai, India Puma Energy Full time

    Main Purpose: Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make...

  • Data Engineer

    3 weeks ago


    Mumbai, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...


  • Mumbai, Maharashtra, India Yo HR Consultancy Full time

    Role : Senior Product Manager, Data : 8 to 12yearMust Have :Product ManagementAgile Description :Roles & Responsibilities :Job Summary :We are seeking a Senior Product Manager to lead and prioritize the development of our Big Data and modeling infrastructure. As a key player in a cross-functional team, you will collaborate closely with other product...


  • Mumbai, India Yo HR Consultancy Full time

    Role : Senior Product Manager, Data : 8 to 12yearMust Have :Product ManagementAgile Description :Roles & Responsibilities :Job Summary :We are seeking a Senior Product Manager to lead and prioritize the development of our Big Data and modeling infrastructure. As a key player in a cross-functional team, you will collaborate closely with other product...


  • Mumbai, India Yo HR Consultancy Full time

    Role : Senior Product Manager, Data : 8 to 12year Must Have : Product Management Agile Description : Roles & Responsibilities : Job Summary : We are seeking a Senior Product Manager to lead and prioritize the development of our Big Data and modeling infrastructure. As a key player in a cross-functional team, you will collaborate closely with other product...


  • mumbai, India Yo HR Consultancy Full time

    Role : Senior Product Manager, Data : 8 to 12year Must Have : Product Management Agile Description : Roles & Responsibilities : Job Summary : We are seeking a Senior Product Manager to lead and prioritize the development of our Big Data and modeling infrastructure. As a key player in a cross-functional team, you will collaborate closely with other product...


  • Mumbai, India Forbes Advisor Full time

    Job DescriptionOur Data team has created this role to support the data engineering team to focus on the highest priority projects that maximize the value of data to internal teams.  The initial priority of the role is to support the data engineering manager to manage the large backlog of tickets for our GCP data architecture, and support communication with...