deployedbyai

The Deploy Log | Breakthroughs | Free, no signup

EMO

Allen Institute for AI | Published

SOURCE Allen Institute for AI, EMO: Pretraining mixture of experts for emergent modularity

Ai2 releases EMO, a 1B-active, 14B-total-parameter MoE trained on 1 trillion tokens, where modular structure emerges from data, allowing selective use of just 12.5% of experts with near full-model performance.

Added to The Deploy Log , updated .

1 row from Allen Institute for AI in The Deploy Log is dated on or before this one: this one, the first.

It reached The Deploy Log 129 days after Allen Institute for AI published it on .

After it from Allen Institute for AI: olmo-eval, 36 days later.

|

One line every time AI actually ships, as it ships, 24/7. Follow the wire: Threads | Bluesky

What this is

The Deploy Log is every deployment deployedbyai has carried, 2569 rows so far, each one sourced to the publisher's own page so you can check the number against it yourself.

All of it is free, with no signup: The Deploy Log, every edition, and the wire, one line every time AI actually ships, on Threads and Bluesky.

Or get the Saturday edition by email: