16k context LLM models
RunPod now supports Panchovix's 16k-token context models.
RunPod
Every deployment from RunPod in The Deploy Log, 4 rows, newest first.
Better Forge template
RunPod released Better Forge, a template for Stable Diffusion pods with a total payload of approximately 12GB.
RunPod Serverless GPU and SGLang
RunPod now supports up to four 80GB GPUs per worker and offers an SGLang quick deploy endpoint.
runpod-python 0.10.0 Local API Server
runpod-python 0.10.0 adds a local API server for testing worker handlers via --rp_serve_api.
The edition every row came from arrives in your inbox, free.
Join free