AWS To Open Source SDK For Optimizing AI Processor Performance
Techstrong.ai, December 12,2025
Amazon Web Services (AWS), beginning in the first quarter of 2026, will make available a Neural Kernel Interface (NKI) it developed to optimize compute kernels running on its Trainium and Inferentia processors under an open source license.
The NKI software development kit (SDK) for AWS Inferentia and Trainium processors integrates machine learning frameworks such as PyTorch, with a compiler for a domain-specific language (DSL), runtime, tools, and libraries.
The primary goal is to provide developers of AI training and inference models with an SDK that makes it possible to maximize performance of AWS processors, says David Nalley, director of developer experience at AWS. 'It's for developers that need to squeeze every ounce of performance,' he says.