deployedbyai

The Deploy Log | Tools | Free, no signup

LLM inference engines

7 LLM inference engines in The Deploy Log, side by side: 41 versions between them, 14 in the last 30 days. Ollama shipped the most of them, 3, then vLLM with 2. Every item sourced to the publisher's own page.

LLM inference engines, most versions in the last 30 days first
ToolCompanyNewestIts dayLast 30 daysA new one
OllamaOllamav0.40.17Undated until its day3every 7 days
vLLMvLLMv0.34.02every 9 days
MLX-VLMMLX-VLMv0.8.02every 12 days
llama.cppllama.cppv1.0.02every 11 days
DynamoNVIDIAv1.6.22every 13 days
ONNX RuntimeMicrosoftv1.32.02every 21 days
KoboldCppKoboldCpp1.124.11every 17.5 days

The newest releases across the 7

  1. MLX-VLM v0.8.0 | SOURCE github.com
  2. vLLM v0.34.0 | SOURCE github.com
  3. llama.cpp v1.0.0 | SOURCE github.com
  4. ONNX Runtime v1.32.0 | SOURCE github.com
  5. vLLM v0.34.0rc1 | SOURCE github.com
  6. Ollama v0.40.16 | SOURCE github.com
  7. Dynamo v1.6.2 | SOURCE github.com
  8. llama.cpp v0.9.0 | SOURCE github.com
  9. MLX-VLM v0.7.12 | SOURCE github.com
  10. Ollama v0.40.14 | SOURCE github.com
  11. KoboldCpp 1.124.1 | SOURCE github.com
  12. Ollama v0.40.13 | SOURCE github.com
  13. ONNX Runtime v1.30.1 | SOURCE github.com
  14. Dynamo v1.6.0 | SOURCE github.com
  15. MLX-VLM v0.7.10 | SOURCE github.com
  16. Ollama v0.40.8 | SOURCE github.com
  17. MLX-VLM v0.7.9 | SOURCE github.com
  18. KoboldCpp 1.123.1 | SOURCE github.com
  19. llama.cpp v0.7.0 | SOURCE github.com
  20. MLX-VLM v0.7.8 | SOURCE github.com

Each tool's every version is on its own changelog page, linked in the table. The last 30 days and the median gap count publisher's dates only.

One line every time AI actually ships, around the clock, free on Threads and Bluesky. Every one is in The Deploy Log with its source.

The Saturday edition is the week in one, free to read on the site, and by email if you want it: get it by email.