Red Hat Delivers Distributed Computing Platform For Running AI Applications
Techstrong.IT, Monday, October 20th, 2025
Red Hat today moved to reduce the complexity of building and deploying artificial intelligence (AI) applications by updating a platform that combines an inference server with an application development and deployment framework based on Kubernetes and a distribution of Linux optimized for these types of applications.
The Red Hat AI 3 platform is based on Red Hat AI Inference Server, Red Hat Enterprise Linux AI (RHEL AI) and Red Hat OpenShift AI in a way that promises to make it simpler for IT teams to mix and match AI accelerators and large language models (LLMs) as they best see fit.
At the core of that effort is llm-d, an open source originally developed at the Sky Computing Lab hosted by the University of California at Berkeley. Red Hat, with the release of the third version of the Red Hat AI platform, is now generally making available a set of llm-d containers that can be deployed on a Red Hat OpenShift AI platform based on Kubernetes.