The Deploy Log | Breakthroughs
EMO
Ai2 releases EMO, a 1B-active, 14B-total-parameter MoE trained on 1 trillion tokens, where modular structure emerges from data, allowing selective use of just 12.5% of experts with near full-model performance.
What this is
The Deploy Log is every deployment deployedbyai has carried, 746 rows so far, each one sourced to the publisher's own page so you can check the number against it yourself.
The Deploy Log and the edition are free, and so is everything a membership adds: the one line of judgement on each row, what to do about it and the condition on that. It becomes $50 a year, and signing up now keeps your first year free.