Search headlines, summaries and articles to connect the dots.
Amazon SageMaker has released the Training Sessions API, enabling users to implement custom large-model training workflows—such as SFT, RLHF, GRPO, and KTO—using pure Python scripts. GPU resource scheduling, fault tolerance, distributed execution, and checkpoint management are all handled by the service.
On October 26, 2026 (UTC), NVIDIA announced that the cuDSS library has entered General Availability (GA). This CUDA-X library is specifically designed to efficiently solve large-scale sparse linear systems on GPUs, significantly boosting simulation throughput and iterative efficiency across fields such as chip design, aerospace, and industrial systems.
This article is the first in a series of technical blog posts jointly published by Hugging Face and Amazon, systematically introducing how to use TorchNeuron on AWS Trainium AI accelerator chips for PyTorch model inference performance analysis. It covers the principles of Neuron backend integration, methods for configuring torch.profiler, the use of NeuronConfig and NeuronProfiler tools, and visualized tracing with Neuron Explorer. Additionally, using RMSNorm as an example, it compares the device‑time differences among three implementations: plain PyTorch, the built-in torch.rms_norm fusion, and torch.compile’s automatic fusion.
i14 has launched the Laplace 3B model with 3.028 billion parameters, which replaces Softmax attention with Gated Linear Attention (GLA). During inference, its per-sequence recursive state remains constant at 29.5 MB, independent of context length. The model was trained and validated on a single AWS trn2.48xlarge instance (equipped with 16 Trainium 2 chips), achieving a training throughput of 120,000 tokens per second and an inference throughput of 11,544 output tokens per second (with 1,280 concurrent sequences). All performance metrics are based on internal measurements conducted by i14 and the AWS GenAIIC team.
