What Is High-Bandwidth Memory (HBM)?
WhatIs, Tuesday, January 28th, 2025
High-bandwidth memory is a type of computer memory that is optimized for fast data transfer and reduced power consumption.
It has become increasingly used and deployed alongside high-performance computing (HPC) and artificial intelligence workloads that require optimized high-speed memory. HBM is used in various computing platforms -- including graphics processing units (GPUs), field programmable gate arrays and AI accelerators.
HBM isn't an entirely unique type of memory. It is an implementation that deploys dynamic random access memory silicon in a different way than it is conventionally used. With HBM, DRAM silicon dies are stacked vertically with a connection technology known as through-silicon vias to achieve high density and performance. TSV technology is a process where thin electrical wires run through holes drilled in the silicon chips to connect multiple layers to a base logic chip. HBM memory can be directly integrated alongside a processor, providing a highly optimized data path.