SeniorFull TimeEN
20 May 2026
What is the purpose of this job?
As the Data Engineering Lead, you will provide senior technical leadership and oversight for oversee Rail Delivery Group’s current AWS-based data platform, ensuring it is robust, scalable and able to support RDG and wider rail-industry needs. You will act as RDG’s principal expert in data engineering, guiding major technical decisions and enabling teams across RDG to deliver high-quality, reliable and efficient analysis and insight.
You will work closely with the Head of Data, Analysis and Insights and the Head of Architecture to ensure the data platform evolves appropriately, supporting increasing volume, complexity and integration demands across the organisation and its partners helping to establish the RDG Data warehouse as a central part of GBR’s data vision. The role also calls for strong leadership skills to mentor and support data engineers at all levels, influencing how data engineering evolves within GBR.
The technologies in use include Redshift, EC2, Glue, Lambda, Kinesis Firehose, Athena, and S3. Proficiency in Python, SQL, and Bash is essential. You’ll encounter a wide range of source systems, from legacy technology patterns to modern solutions, working with both fixed-width files and contemporary REST APIs, as well as managing batch and streaming data workflows. To further develop RDG’s DataOps practice, you should be comfortable with both the technical tooling and process aspects of DevOps.
This isn’t an exhaustive list, but things you can expect to be involved with include:
Who will my key contacts be?
The role requires extensive collaboration with both internal and external teams. Some of those are listed below.
Internally to RDG:
Externally:
Requirements
As Data Engineering Lead, you will bring proven experience working with extremely large datasets (including tables with over 85 billion records), writing efficient SQL, and building both batch and streaming pipelines in Python. You’ll have hands-on AWS expertise in a data context within the last three years, and a strong grasp of modern data storage and processing options, such as data lakes, warehouses, relational and key-value stores, and distributed frameworks like Spark. Experience with CI/CD and DataOps is essential, ideally including the development of pipelines and tooling.
You will champion best-practice data warehouse and data lake design, driving automation and high standards in code quality. You’ll lead by example, curious about data and eager to uncover insights
whilst unafraid to challenge and transform data where needed. Above all, they will be a team player who champions continuous improvement and personal development.
Benefits
Why Work for RDG?
We offer a highly competitive package, including:
Career Development & Progression
You’ll be part of a team driving innovation at a national scale, with the opportunity to influence long-term ticketing strategy. This role provides real ownership, the chance to work with leading-edge technologies and partners, and visibility at senior levels across the rail industry. You’ll also gain wide exposure to transport and government stakeholders, opening up exciting development and progression opportunities within RDG.
Apply Now & Shape the Future of UK Rail
If you are interested in joining RDG as a Lead Solution Architect and shaping the future of digital ticketing, we’d love to hear from you!
Click Apply now to start your application and be part of a team that is leading digital innovation in the rail industry.
Please note that we are unable to consider applications from candidates who require visa sponsorship to work in the UK.
