The Deploy Log | Breakthroughs
TurboQuant
Google Research introduced TurboQuant, a quantization algorithm that compresses key-value cache to 3 bits without accuracy loss, achieving up to 8x performance increase over 32-bit unquantized keys on H100 GPUs.
What this is
The Deploy Log is every deployment deployedbyai has carried, 746 rows so far, each one sourced to the publisher's own page so you can check the number against it yourself.
The Deploy Log and the edition are free, and so is everything a membership adds: the one line of judgement on each row, what to do about it and the condition on that. It becomes $50 a year, and signing up now keeps your first year free.