How To Run Quantized Models On Precision Workstations
Dell News, Wednesday, December 20,2023
A practical guide to understand how to configure your PC to work effectively with generative AI large language models.
Generative AI (GenAI) has crashed the world of computing, and our customers want to start working with large language models (LLMs) to develop innovative new capabilities to drive productivity, efficiency and innovation in their companies. Dell Technologies has the world's broadest AI infrastructure portfolio that spans from cloud to client devices, all in one place*-providing end-to-end AI solutions and services designed to meet customers wherever they are in their AI journey.
Dell also offers hardware solutions engineered to support AI workloads, from workstation PCs (mobile and fixed) to servers for high-performance computing, data storage, cloud native software-defined infrastructure, networking switches, data protection, HCI and services. But one of the biggest questions from our customers is how to determine whether a PC can work effectively with a particular LLM. We'll try to help answer that question and provide some guidance on configuration choices that users should consider when working with GenAI.