Ai2 released olmo-eval, an evaluation workbench that builds on OLMES and supports agentic and multi-turn evaluation, pairwise model comparison, and per-question analysis with standard errors and minimum detectable effects.
Added to The Deploy Log , updated . Read Edition 38, the edition that carried it.
2 rows from Allen Institute for AI in The Deploy Log are dated on or before this one, this one included.
Before it from Allen Institute for AI: EMO, 36 days earlier. After it: MolmoMotion, 7 days later.
|
One line every time AI actually ships, as it ships, 24/7. Follow the wire: Threads | Bluesky
One line every time AI actually ships, around the clock, free on Threads and Bluesky. Every one is in The Deploy Log with its source.