Software Engineer - AI Evaluation

The Role

AI is at the heart of what Board Intelligence builds. Boards and senior leaders rely on our AI to support their most important decisions, so the quality of its output has to be close to perfect.

We are looking for a Software Engineer to join our AI team as its dedicated engineer. The team includes prompt engineers and subject matter experts, and you will build the systems they need. Your first priority is our AI evaluation suite: the tools we use to measure and improve the quality of AI output across our products. Over time, you may move on to building one of our AI-powered products.

You do not need deep AI or machine learning experience; the team will help you get up to speed quickly. What matters is that you are a strong full-stack engineer who is comfortable in ambiguity and happy to build largely independently, in a field where good practice is still being defined.

Whilst we aren't fully remote, we are flexible on office presence and can consider hybrid approaches of 2-4 days per month onsite in London. 

Main Responsibilities

Design and build our AI evaluation suite, the systems we use to measure and improve the quality of AI output

Build across the full stack yourself, from data pipelines and backend services to the front-end tools our experts use

Work closely with prompt engineers and subject matter experts, turning their knowledge into tests, metrics and tooling

Help define how we measure AI quality, in a field where practices are still forming

Make evaluation processes and results automated as part of our SDLC, so product teams can ship with confidence

Over time, contribute to building our AI-powered products

Person Specification

We are looking for a strong all-round engineer who is comfortable working independently, enjoys ambiguity and wants to work at the forefront of AI quality.

Required Skills and Experience

Upper mid-level to senior professional software engineering experience

Experience building AI powered products or tooling

Full-stack experience across front end and back end

Comfort working independently and in ambiguity, setting your own direction

Experience collaborating with non-engineers and turning their expertise into working software

A strong focus on quality, testing and attention to detail

Experience using AI coding tools in your day-to-day work

Fluent written and spoken English

Nice to haves

Experience with building evaluation suites for AI products

Experience with Python and TypeScript

Experience building internal tools, testing frameworks or data pipelines

Experience at a startup or in a small team where you built things end to end

What good looks like in this role

After three months: the first version of the evaluation suite is running and our engineering teams are using it

After six months: evaluations cover all of our AI products and are integrated into the SDLC

After twelve months: evaluation is a standard part of how we ship AI, and you are a trusted voice on AI quality across engineering

How We Work

We hire people who are expert at what they do. Once you join, you have the autonomy to shape how you work and the space to do it well. That doesn’t mean working in isolation. You’ll have colleagues who know their craft, regular collaboration across functions, and easy access to senior leadership when you need it.

We keep our structure flat. We work at pace in an agile, nimble environment where good ideas don’t wait for permission. If you spot something that could work better, we encourage you to say so. If you want to run with an idea, we’ll back you to do it.

We work with people who take pride in their output, back their team through the hard parts, and leave things better than they found them.

We are number 33 in Jack & Jill's most wanted places to work 2027!

Benefits

Our package reflects what matters to people who do serious work:

• Competitive salary
• Pension scheme
• Personal performance bonus
• 26 days’ holiday each calendar year
• Bupa health and dental cover
• Group life assurance
• Employee Assistance Programme
• Cycle to Work scheme
• Referral bonus
• Claude licence: AI tools integrated into your daily work to multiply your impact
• Annual all-company Summer Away Day
• Regular team socials

What Happens Next

Once you apply, our Talent team will review your application. If there’s a fit, they’ll be in touch to discuss the role and next steps.

How We Use AI in Our Hiring

We use AI responsibly, both in the software we build for governance teams and in how we hire. Our Talent team may use AI to support application review, CV analysis, or identifying areas that need further verification.

But hiring decisions are made by people. AI surfaces signals; people make the call on whether to progress a candidate or extend an offer.

If you’d like details on how your data is handled during recruitment, contact our Talent team.

Diversity, Equity and Inclusion

We’re an equal opportunities employer. We’re building a team that works because it reflects a breadth of experience, background, and perspective.

Apply even if you don’t tick every box on the job specification. If the role excites you and you think you could make an impact, we want to hear from you.

We don’t discriminate on the basis of age, disability, ethnicity, gender, religion, sexual orientation, or any other protected characteristic. If you need reasonable adjustments at any stage of recruitment, or if there’s anything else we can do to make the process more accessible, tell our Talent team. We’ll sort it.

Your Safety Matters

Be cautious of unexpected messages claiming to be from Board Intelligence. We will never ask you for fees as part of recruitment. If you’re unsure whether a communication is genuine, contact our Talent team through our official channels before sharing information or clicking links.