Callosum is building a unified benchmarking system for evaluating agentic and algorithmic AI work. The role focuses on reproducible, contamination‑controlled evaluation across motifs and decomposition strategies, grounded in real execution traces and sandboxed grading.
You will architect and implement pipelines that measure task success, quality and robustness, influencing which approaches ship and how we communicate proof points to customers.
#J-18808-Ljbffr
Join us at AI Startups UK as our next AI Benchmarking Architect in Greater London, England, United Kingdom.
We have an opening for a AI Benchmarking Architect in Greater London, England, United Kingdom within IT & Technology.
This role, AI Benchmarking Architect at AI Startups UK, could be your next career step.
Are you ready to take on the AI Benchmarking Architect role at AI Startups UK?
We would love to welcome a new AI Benchmarking Architect to our group in Greater London, England, United Kingdom.