AI Test Lead
Job ID: 010123
Location: Leeds, UK, LS1 8EQ
Job type: Permanent - Full Time
Salary: £44,000 - £65,000 Dependant upon Experience + Bonus & Benefits
Apply now
Are you passionate about making a difference, using your skills & experience to be a key enabler of AI-driven transformation? If so, we may have the role for you!
We are excited to share an incredible opportunity for an AI Test Lead to join our team in Data & AI. As our newest AI Test Lead, you will be responsible for defining and leading testing and quality assurance practices for AI-enabled systems and solutions.
This is a hybrid role with working from home plus some onsite presence in our Bradford & central Leeds offices.
About the role
The role addresses the unique challenges of testing AI systems, including probabilistic behaviour, variability in outputs, and responsible AI considerations. Through robust testing frameworks and collaboration with delivery and governance teams, the role supports compliant and trustworthy deployment of AI solutions within a regulated financial services environment.
You will-
- Develop AI testing frameworks and methodologies that account for nondeterministic behaviour, probabilistic outputs, and variability in AI responses.
- Embed responsible AI and risk testing by defining test cases that assess bias, fairness, transparency, safety, and the effectiveness of AI guardrails.
- Implement automated AI testing capabilities by developing test automation and integrating testing activities into DevOps and MLOps pipelines.
- Collaborate across delivery and governance teams to ensure testing practices align with engineering standards, regulatory expectations, and enterprise assurance requirements.
About You
You will have
- Strong experience in testing and quality assurance for complex systems
- Working knowledge of AI and machine learning technologies, including large language models and RetrievalAugmented Generation (RAG)
- Familiarity with test automation, DevOps pipelines, and MLOps practices
- Experience working with Microsoft Azure, Azure AI services, and Copilotbased solutions
- Strong collaboration and communication skills, including engagement with nontechnical stakeholders
About Our Benefits
Everyone’s different. That’s why we offer a wide range of benefits and rewards that we think you’ll love – whatever’s important to you, and whatever stage of life you’re at. Such as…
-
Our pension scheme (where you can get up to 11% from us)
-
On target bonus of 7% (with the opportunity to earn up to a maximum 15%)
-
Access to brilliant health benefits
-
Life assurance at 6 times your salary
-
25 days’ holiday (and the option to buy more)
-
Cycle to work or an interest-free loan for an annual ticket
-
Wellbeing resources and tools
-
Retail and Leisure discounts
Learning & Development
Everyone can build a career path they love here. And that’s because we offer a wide range of programmes, opportunities and more to help you learn, grow, and develop – and reach your full potential.
These include...
- Personal Growth Toolkits - a range of materials that help you discover your strengths, identify your goals, and your next steps.
- Secondment and Stretch opportunities – helping you gain experience in different areas of our business and new ways of working.
- Learning Champion Network – opportunities to work outside of your immediate area and build new skills.
- Apprenticeships and Professional Qualifications – a range of brilliant apprenticeships and programmes available to everyone.
- REACH Diverse Leadership Programme – helping our Black, Asian and Ethnically Diverse leaders progress into senior leadership roles.
Our Colleague Networks & Groups
Our Vision is to be a leading organisation that embraces diversity, champions equity, and creates an inclusive environment where all individuals regardless of their background or identity feel valued, empowered and supported.
Our Colleague Networks and Groups are designed to amplify the voices of diverse groups and provide a structured route to effect real change. They provide a safe space and use colleague feedback to support the progression of our DEI Strategy. Our eight networks and groups are:
Community and Charity
Ever since we started back in 1864, we’ve had a clear purpose – to do some good in our communities through helping people keep their savings safe. And helping everyone have a place to call home. Today, that purpose is still a huge part of who we are. And every one of our colleagues helps that happen.
We’re committed to volunteering our time, resources, skills and knowledge – more than 50% of colleagues contribute to thousands of volunteer hours every year. And our Charitable Foundation has now donated over £9 million to charities and good causes across the country.
Hear from some of our people about what working at Yorkshire Building Society is like, and what it means for them…
Our ways of working
We know there’s no single right way of working that fits everyone. That’s why we’re not trying to find one. Instead, we’re doing everything we can to make sure that when we’re working flexibly, together and apart, we’re working at our best. And help our colleagues get the most out of work, and take care of themselves, wherever they’re working.
Whether you’re in an office-based team or your team is spread across the country, you’ll have lots of chances to get together with your colleagues for those Moments that Matter – which are all about building wonderful relationships and strong bonds with your colleagues.
Find out more about our Ways of Working here:Similar Roles
-
Sorry, no similar jobs found local to this role.