SageMaker HyperPod Gateway
Amazon SageMaker HyperPod Inference Gateway is a Kubernetes-native, GPU-aware routing system that deploys as a single EKS managed addon and reduces first-token latency by up to 82%.
The call on this one
What shipped is free. The call on it, what to do about it and the condition on that, opens with a signup: free, no card, every edition in full.
It becomes $50 a year, and signing up now keeps your first year free.