AI90 Tiers HBM, DDR, and SSD Capacity Across Eight RTX 5090 GPUs AI90以HBM、DDR和SSD分层扩展八张RTX 5090
AI90 combines HBM, DDR, and SSD storage to extend the usable memory capacity of a system built around eight RTX 5090 GPUs, according to TechRadar. The tiered design targets a recurring inference constraint: model and KV-cache footprints can exceed local GPU memory even when sufficient compute is available. 据TechRadar报道,AI90把HBM、DDR和SSD组成分层存储,为配备八张RTX 5090 GPU的系统扩展可用内存容量。该设计瞄准推理中的常见约束:即便算力充足,模型与KV-cache的占用仍可能超过GPU本地显存。