deployedbyai
Follow

The Deploy Log | Models and APIs | Free, no signup

Streaming datasets

Hugging Face | In Edition 7,

The call on this one

DEPLOYif you train on multi-TB datasets

SOURCE Hugging Face, Streaming datasets: 100x More Efficient

Hugging Face improved streaming datasets with 100x fewer startup requests, 10x faster data resolution, and up to 2x faster streaming speed, outrunning local SSDs when training on 64xH100 with 256 workers.

Added to The Deploy Log , updated . Read Edition 7, the edition that carried it.

14 rows from Hugging Face in The Deploy Log are dated on or before this one, this one included.

The same day from Hugging Face: Granite 4.0 Nano (0 days apart). After it: ROCm kernel builder, 16 days later.

|

One line every time AI actually ships, as it ships, 24/7. Follow the wire: Threads | Bluesky

Hugging Face: every row that names it

One line every time AI actually ships, around the clock, free on Threads and Bluesky. Every one is in The Deploy Log with its source.

The Saturday edition is the week in one, free to read on the site, and by email if you want it: get it by email.