Software Engineer - AI Evaluation

Overview

In this role you join Board Intelligence’s AI-focused engineering team to build and improve the AI evaluation suite, ensuring high-quality AI output. You’ll work across the full stack to support data pipelines, back-end services, and front-end tools used by experts. The role combines independent work with collaboration with prompt engineers and SMEs to define tests, metrics, and tooling. It offers a path toward contributing to AI-powered products while shaping how we measure AI quality in a fast-evolving field.

Pay / Benefits

• Pension scheme
• Personal performance bonus
• 26 days holiday each calendar year
• Bupa health & dental cover
• Group life assurance
• EAP

Responsibilities

• Design and build the AI evaluation suite to measure and improve AI output quality
• Implement full-stack solutions from data pipelines to frontend tools used by experts
• Collaborate with prompt engineers and SMEs to translate knowledge into tests, metrics, and tooling
• Help define AI quality measurement practices in a building field
• Automate evaluation processes within the SDLC so product teams ship with confidence
• Contribute over time to AI-powered product development

Key requirements

• Upper mid-level to senior software engineering experience
• Experience building AI-powered products or tooling
• Full-stack experience across frontend and backend
• Ability to work independently in ambiguity and define own direction
• Experience collaborating with non-engineers and translating expertise into software
• Strong focus on quality, testing and attention to detail
• Experience using AI coding tools in day-to-day work
• Fluent written and spoken English
• Independent and proactive
• Strong communication with non-engineers
• Quality-focused and detail-oriented
• Full-stack development (frontend and backend)
• Python
• TypeScript

Report this job