NVIDIA Powers Training for Some of the Largest Amazon Titan Foundation Models
NVIDIA News, Tuesday, November 28,2023
How Amazon used the NVIDIA NeMo framework, GPUs and EFA from AWS to train some of its largest next-generation LLMs.
Everything about large language models is big - giant models train on massive datasets across thousands of NVIDIA GPUs.
That can pose a lot of big challenges for companies pursuing generative AI. NVIDIA NeMo, a framework for building, customizing and running LLMs, helps overcome these challenges.
A team of experienced scientists and developers at Amazon Web Services creating Amazon Titan foundation models for Amazon Bedrock, a generative AI service for foundation models, has been using NVIDIA NeMo for over the past several months.