S

Sampura Research

AI safety nonprofit for scalable oversight

Founding Member of Technical Staff

AI ResearchConfirmed live in the last 24 hours
Full-timeLondon, UK£100k - £290k

About the Job

Requirements

  • A Bachelor's degree or higher in Computer Science, Mathematics, or a related field, or equivalent experience.
  • Strong Python engineering skills and experience working in large collaborative codebases and the modern machine-learning stack, such as large language model inference application programming interfaces, PyTorch or JAX, and data-analysis tooling.
  • Experience training and evaluating large language models, including critically assessing datasets and analyzing results quantitatively and qualitatively.
  • Willingness to use artificial intelligence tools thoughtfully, applying scrutiny and human review where necessary.
  • A track record of rigorously and ethically exploring and resolving open-ended research questions in academic or industry labs, fellowships, or volunteer research programs.

Responsibilities

  • Shape research and engineering direction alongside the founding team, and own end-to-end research and engineering problems within the research agenda.
  • Build diverse, high-quality evaluations for judge protocols, spanning static datasets (existing and novel) and dynamic settings where policies optimize against the judge during reinforcement learning.
  • Research and implement strategies to improve human-plus-AI judge protocols, such as learning to defer, AI-generated assistance for human raters, and co-training large language model judges alongside the policy during reinforcement learning.
  • Build tools to enable and scale the research agenda, including large-scale evaluation and training pipelines, a human rating platform, and a public judge leaderboard.
  • Scope ambiguous problems independently, communicate progress, and synthesize findings into papers, blog posts, and benchmark releases.

Desired Qualifications

  • Demonstrated ownership across multiple parts of the AI research lifecycle, including experiment design and execution, infrastructure, data collection and processing, and inference.
  • Expertise in a highly relevant domain such as model confidence or calibration, interpretability, safety or alignment evaluation, human-computer interaction, or another field related to scalable oversight.
  • Hands-on experience with post-training methods such as reinforcement learning, adversarial fine-tuning, or distillation, especially when applied to judges or reward models.
  • Hands-on experience with human data collection and rater-study design.
  • Leadership as a mentor or team lead for related research, either inside a research lab or through programs such as SPAR, MARS, or MATS.

About the Company

Sampura Research

AI safety nonprofit for scalable oversight

Sampura Research is a London-based nonprofit that studies AI safety by building scalable ways to oversee frontier AI models. It creates human-AI complementarity methods to form better judges—composed of humans, AI, or hybrids—that can judge whether a model’s behavior in chats or agent trajectories is correct and aligned. Its first offering is a diverse judge leaderboard covering areas like deception detection, cultural bias, and unsafe agent actions, with methods that decide when to pass tasks to humans or to AI based on confidence. This approach sets Sampura apart by linking a practical, scalable oversight framework to a public leaderboard, backed by a significant grant to support research. The goal is to advance safe and aligned AI by improving how models are watched, judged, and guided in real time.

Company size
1-10
Company stage
Grant
Total funding
$11M
Headquarters
London, United Kingdom
Founded
2026

Recently Posted Jobs

Explore more opportunities at Sampura Research

See more jobs