Task-conditional compute skipping for multi-task inference accelerators 面向多任务推理加速器的任务条件计算跳过
arXiv:2607.22038 · 2026-07-24
Sparse by Command uses the task command available before inference to predict hardware-aligned tile masks, letting a multi-task accelerator skip irrelevant work. It co-designs training, an ISA carrying tile bitmasks, and a scheduler, but real gains will depend on task mix and gate accuracy. Sparse by Command利用推理前已知的任务指令预测与硬件对齐的Tile掩码,使多任务加速器跳过无关计算。它协同设计训练、携带Tile位掩码的ISA和调度器,但实际收益仍取决于任务组合与门控准确性。