awsdocs-neuron.readthedocs-hosted.com
AWS Neuron is the software development kit (SDK) for deep learning and generative AI on AWS Inferentia and Trainium instances. It supports multiple development paths including serving large language models with vLLM, training and inference with PyTorch and JAX, and authoring custom kernels with the Neuron Kernel Interface (NKI).
AI named Amazon Neuron SDK from January 2026 to March 2026.
Brand page for awsdocs-neuron-readthedocs-hosted-com