Data Engineering Professional

Our Data and AI vision is to reinvent BT Group as the market leader in AI-powered connectivity, solutions and services, helping businesses, public sector communities and society improve the way they live and work. We'll do this by building foundations to strengthen our core platform, while keeping ethics and responsible delivery at the core and, by harnessing data and AI to reinvent BT Group, solve business and customer problems and drive value through innovation. Underpinning the success of the strategy are our people, using our collective expertise in Data and AI to partner with the organization and drive a data-led culture.  

Ab Initio Expertise & Data Fabric Engineering

•    Design, develop, and optimize ETL workflows using Ab Initio GDE, Metadata Hub (MDH), Co>Op, Express>IT and Control Centre.

•    Build and manage batch and continuous flow pipelines.

•    Implement and support Data Fabric patterns and reusable components.

•    Troubleshoot and resolve complex Ab Initio performance and integration issues.

Cloud & Containerization (GCP, Kubernetes)

•    Develop and deploy cloud-native data pipelines using GCP services such as BigQuery, Cloud Storage, Dataflow and Pub/Sub.

•    Orchestrate and manage Ab Initio jobs on Kubernetes clusters for scalability and resilience.

•    Preferred: Exposure to AWS or Azure cloud platforms.

•    Contribute to cloud migration strategies aligned with CDMC compliance.

Data Engineering Design, CI/CD & Agile Delivery

•    Translate business requirements into scalable, performant data solutions.

•    Apply best practices in ETL design, data modelling, and data warehousing.

•    Participate in Agile ceremonies, code reviews, and CI/CD pipelines.

•    Document technical designs and contribute to team knowledge sharing.

Functional Knowledge & Technical Skills

•    Ensure data quality, lineage, and governance across the Ab Initio ecosystem.

•    Contribute to cloud migration strategies aligned with CDMC compliance.

•    Expertise in BI dashboard development, automation, and integration with governance systems.

•    Knowledge of data pipelines, SQL, APIs, and governance tooling.

•    Excellent analytical, problem-solving, and communication skills.

Leadership & Interpersonal Skills

•    Mentor junior developers and foster a culture of continuous improvement

•    Foster collaborative mindset within the team.

•    Hands-on experience with Kubernetes and CI/CD pipelines.

•    Familiarity with DevOps practices and tools.

•    Experience with other ETL tools (e.g., Informatica, IBM DataStage).

•    Ab Initio or cloud certifications are a plus.

•    Experience working in Agile environments (Scrum/Kanban).

•    Bachelor's or Master's degree in Engineering - Computer Science, IT, or related fields.

•    Minimum 3+ years of hands-on experience with Ab Initio development.

•    Strong SQL skills and experience with databases like Oracle, PostgreSQL, or SQL Server.

•    Proficiency in Python/Unix/Linux shell scripting.

Looking in:

Leading inclusively and Safely

I inspire and build trust through self-awareness, honesty and integrity.

Owning outcomes

I take the right decisions that benefit the broader organisation.

Looking out:

Delivering for the customer

I execute brilliantly on clear priorities that add value to our customers and the wider business.

Commercially savvy

I demonstrate strong commercial focus, bringing an external perspective to decision-making.

Looking to the future:

Growth mindset

I experiment and identify opportunities for growth for both myself and the organisation.

Building for the future

I build diverse future-ready teams where all individuals can be at their best.

About us

BT Group was the world's first telco and our heritage in the sector is unrivalled.  As home to several of the UK's most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached an inflection point in the transformation of our business. 
 
Over the next two years, we will complete the UK's largest and most successful digital infrastructure project – connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we play a central role in revolutionising how people connect with each other. 
 
While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the best way to serve our customers in the years to come. This includes radical simplification of systems, structures, and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the UK's best telco, reimagining the customer experience and relationship with one of this country's biggest infrastructure companies.  
 
Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being the driving force behind improving connectivity for millions and there has never been a more exciting time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era.

A FEW POINTS TO NOTE:

Although these roles are listed as full-time, if you're a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us.

DON'T MEET EVERY SINGLE REQUIREMENT?

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.