Amazon SageMaker TTS service enables metric-driven auto-scaling: taking the Kokoro-82M model as an example.
The AWS blog introduces an empirical, automated scaling method for deploying text-to-speech (TTS) models on SageMaker real-time endpoints, eliminating guesswork and basing the approach on two measured metrics—Q_max (the maximum sustainable concurrent requests per instance) and T_total (the time required for planned scaling)—to create a reproducible, verifiable scaling strategy.