Cloudy With A Chance Of GPU Bills: AI's Energy Appetite Has CIOs Sweating
CIO, Friday, November 29th, 2024
Public cloud expenses have businesses scrambling for alternatives that won't melt the budget
Organizations are being forced to rethink where they host workloads in response to ballooning AI demands combined with rising energy bills, and shoving them into the public cloud may not be the answer.
CIOs are facing a quandary over rising power consumption from the huge compute demands of training and deploying advanced AI models, while energy costs are simultaneously rising. Finding some way to square this circle is becoming a big concern for large corporates, according to Canalys.