Wide Horizons: NVIDIA Keynote Points Way To Further AI Advances
NVIDIA, Wednesday, August 30,2023
Dramatic gains in hardware performance have spawned generative AI, and a rich pipeline of ideas for future speedups will drive machine learning to new heights, Bill Dally, NVIDIA's chief scientist and senior vice president of research, said today in a keynote.
Dally described a basket of techniques in the works - some already showing impressive results - in a talk at Hot Chips, an annual event for processor and systems architects.
'The progress in AI has been enormous, it's been enabled by hardware and it's still gated by deep learning hardware,' said Dally, one of the world's foremost computer scientists and former chair of Stanford University's computer science department.
He showed, for example, how ChatGPT, the large language model (LLM) used by millions, could suggest an outline for his talk. Such capabilities owe their prescience in large part to gains from GPUs in AI inference performance over the last decade, he said.