Senior Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer

Location: Bangalore-Manyata Tech Park

Business & Team: CDAO

Impact &contribution:  

• You are a passionate data engineer & keen learner with strong multi-disciplinary background in end-to-end data & analytics delivery value chain activities and modern data engineering technologies/tooling/practices
• We are a values-driven high performing  team

Roles & responsibilities

Accelerated data delivery:

• Understand business problems and devise data & analytics driven solutions
• Innovate to continuously identify opportunities to simplify, automate & improve data delivery speed
• Deliver proof of concepts/ technical spikes and leading examples of accelerated data delivery using new solution patterns/ capabilities
• Execute end-to-end data delivery iteratively through requirements, solutioning, data profiling, data design/ modelling, development, testing, release management and operate in production
• Develop strategic data products
• Ensure industry best practices of engineering and Data DevSecOps are followed

Data delivery practice:

• Provide data delivery guidance for evolving needs from federation, strategy and transformation
• Contribute to data delivery knowledge management outcomes via playbooks, learning materials & education sessions
• Contribute to data maturity outcomes and data literacy initiatives

Essential skills:

• Minimum exp is 8+ years of experience at Senior data engineer level in large Banks/ organizations
• Good understanding of data delivery life cycle & associated concepts including data analysis, data profiling, data design, data modelling, data ingestion, data cleansing, data extraction, data definitions/dictionary, data lineage mapping, data classification, data quality, etc.
• Sound Programming Skills in the programming languages like:PySpark, Python, Java, Scala (any one)
• Experience in Big Data solutions using Cloudera Hadoop eco-systems, Teradata platform using Spark/TCF and various ETL frameworks
• Experience with AWS Cloud platform and Snowflake
• Awareness of data modelling concepts/ frameworks, design patterns (FSLDM, IBM IFW DW, BIAN) and techniques such as Data Vault, Kimball, 3NF
• Sound skills in writing SQL scripts using Spark SQL or any RDBMS (DBT - Data Build Tool is good to have)
• Sound experience in building data pipelines & ETL tools - AWS Data Stack (Ab Initio is good to have)
• Experience in designing and developing ETL test scripts for structured and unstructured data
• Sound skills testing solutions with large data volumes and complex data transformation rules
• Sound Leadership and behavioural skills including Active Listening, Constructive Challenge, Problem Solving and Risk management.
• Sound in AI and Data Literacy with an experience and ability to use AI Tools into development lifecycle

Education Qualification: Bachelor's degree or Master's degree in Engineering in Computer Science/Information Technology

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We're keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on