semi·news
Headlines要闻 / Research研究 / /
Research digest · Tuesday, September 8, 2026 研究摘要 · 2026年9月8日 星期二

Inference Efficiency Moves Down the Stack 推理效率沿技术栈持续下沉

This week's papers compress context, KV cache, weights, and even neural firing while reusing highly tuned GPU primitives. Reliability work also exposes silent corruption paths in radiation-exposed accelerators and quantum-software postprocessing. 本周论文从上下文、KV cache、权重乃至神经元放电等层面压缩推理成本,同时复用高度优化的GPU原语。可靠性研究还揭示了受辐射加速器与量子软件后处理中的静默错误路径。

Look-back window: 7 days · 8 paper(s) 回溯窗口: 7天 · 8篇

Circuits, Architecture & Reliability 电路、架构与可靠性

Proton Irradiation of an Open-Source ML Accelerator 开源机器学习加速器的质子辐照表征

S. Memon, R. Graczyk, J. Swakoń, et al.

arXiv:2609.05249 · 2026-09-04T15:14:59Z

A Tensil neural-network accelerator on a Zynq UltraScale+ MPSoC was exposed to 20–58 MeV protons at a monitored fluence of 4.29 × 10^10 p/cm² while running ResNet-20 inference. The test recorded seven workload interruptions and two silent output-corruption events, including 39 consecutive invalid classifications without a kernel, memory, or power anomaly. It is a system-level baseline for an unmitigated implementation, not yet evidence that a particular mitigation will work in flight. 研究将部署在Zynq UltraScale+ MPSoC上的Tensil神经网络加速器置于20–58 MeV质子辐照下,并在运行ResNet-20推理时累计监测到4.29 × 10^10 p/cm²的注量。测试出现7次工作负载中断和2次静默输出损坏,其中一次连续39个输入产生无效分类,但内核日志、有限内存测试和功耗采样均未报错。这是未加固实现的系统级基线,尚不能证明某项缓解措施能在太空任务中奏效。

AI Accelerators & Compute-in-Memory AI加速器与存算一体

Large Language Models with At Most One Spike per Neuron 每个神经元至多放电一次的大语言模型

Z. Zhao, P. Omidi, A. Jafari, et al.

arXiv:2609.05151 · 2026-09-04T13:53:28Z

A reference-based time-to-first-spike scheme maps embeddings, normalization, attention operations, and dropout into an end-to-end spiking LLM with at most one spike per neuron. The work scales the approach to 1.5 billion parameters and matches conventional neural networks on several language-understanding and common-sense tasks, but language-modeling perplexity still trails. Energy gains are estimated from spike activity rather than measured on dedicated neuromorphic silicon. 研究采用基于参考值的首脉冲时间编码,将嵌入、归一化、注意力运算和dropout映射到端到端脉冲LLM中,使每个神经元至多放电一次。该方法扩展到15亿参数,并在若干语言理解与常识任务上达到传统神经网络相近表现,但语言建模困惑度仍有差距。能耗收益来自脉冲活动估算,而非专用神经形态芯片的实测结果。

Best-Matching-Unit Search Reaches the GPU L2 Bandwidth Roof 最佳匹配单元搜索触及GPU L2带宽上限

A. J. Amos

arXiv:2609.05138 · 2026-09-04T13:38:42Z

A SparseBin best-matching-unit kernel for self-organizing maps improves 5.6–10.1× over its earlier configuration and reaches roughly 385× the older CUDA implementation used in prior MEDLINE atlases. The comparison also tunes the cuSPARSE baseline, which becomes 2–3× faster, while the new kernel reaches 77% of peak L2 bandwidth. The result is specific to this search kernel and workload family, but the symmetric tuning makes the speedup more credible than an untuned-baseline comparison. 面向自组织映射的SparseBin最佳匹配单元内核,相比早期配置提速5.6–10.1倍,并达到此前MEDLINE图谱所用旧CUDA实现约385倍的速度。研究同时优化cuSPARSE基线,使其提速2–3倍;新内核则达到峰值L2带宽的77%。结果仅针对该搜索内核及其工作负载族,但对双方进行对称优化,使性能对比比使用未调优基线更可信。

Structured Pruning and Bit-Packed Quantization for Microcontrollers 面向微控制器的结构化剪枝与位打包量化

O. M. Busoye, T. M. Busoye, E. Eigbe

arXiv:2609.05081 · 2026-09-04T12:38:07Z

Deep Microcompression combines structured pruning, quantization-aware training, and fixed-length bit packing to compress LeNet-5 weights by 55.8× while retaining 98.77% accuracy. On an RP2040 it cuts binary size by 3× versus TensorFlow Lite, and it fits a standard CNN onto an ATmega328P with only 2 KB of SRAM. The evidence is limited to a small, mature vision model, so scaling to modern networks remains unproven. Deep Microcompression结合结构化剪枝、量化感知训练与定长位打包,在保持LeNet-5准确率98.77%的同时实现55.8倍权重压缩。它在RP2040上的二进制体积比TensorFlow Lite缩小3倍,并将标准CNN部署到仅有2 KB SRAM的ATmega328P上。现有证据仅覆盖规模较小且成熟的视觉模型,能否扩展到现代网络尚未得到验证。

Hardware-Relevant AI Research 硬件相关AI研究

Two-Stage Soft Context Compression for RAG 面向RAG的两阶段软上下文压缩

S. Guo, S. Zhang, Z. Ren

arXiv:2609.05152 · 2026-09-04T13:53:43Z

DEX-Comp first distills correct answers from an uncompressed RAG system, then applies reinforcement learning only to queries that baseline misses. Across five open-domain QA benchmarks and retrieval depths from top-5 to top-30, it compresses context by 16× and reports 4–24× faster inference with performance comparable to or better than the uncompressed baseline. The gains are benchmark results from a preprint and still need validation under production retrieval distributions. DEX-Comp先从未压缩RAG系统的正确答案中蒸馏,再仅针对基线答错的问题进行强化学习。它在5个开放域问答基准以及top-5至top-30检索深度下,将上下文压缩16倍,并报告4–24倍推理加速,效果与未压缩基线相当或更好。这些收益来自预印本的基准测试,仍需在生产环境的检索分布下验证。

Beacon Queries Preserve Long-Range KV-Cache Context Beacon查询保留KV cache中的远程上下文

J. Kim, M. Kim, K. Shim, et al.

arXiv:2609.04971 · 2026-09-04T10:23:16Z

BeaconKV targets long reasoning traces where later tokens revisit plans and evidence far back in the sequence, breaking eviction policies based mainly on recent queries. It clusters these thought-revisiting queries and keeps compact beacon representatives to select KV entries without retaining the full query history. The method is training-free and evaluated across four open-source reasoning models, though the available preprint abstract does not expose enough detail to judge hardware-level throughput gains. BeaconKV针对长推理轨迹中后续token重新访问早期计划与证据的现象,这会使主要依赖近期查询的淘汰策略失效。该方法对这类“思路回访”查询进行聚类,并保留紧凑的Beacon代表,以便在不保存完整查询历史的情况下选择KV条目。它无需训练,并在4个开源推理模型上评估,但现有预印本摘要未提供足够细节来判断硬件层面的吞吐提升。

Fast Gaussian Sums Reuse Flash Attention Kernels 快速高斯求和复用Flash Attention内核

N. Rux, S. Neumayer

arXiv:2609.04910 · 2026-09-04T09:11:45Z

Two small input augmentations transform normalized softmax reduction into Gaussian kernel sums with arbitrary signed weights, allowing existing Flash Attention code to execute the operation. For feature dimension D > 8 in fp16, the approach beats compiled PyTorch and PyKeOps kernels in speed, memory overhead, and accuracy while retaining linear memory scaling. The result is attractive because it inherits mature GPU optimization, but its advantage depends on dimension, precision, and the available Flash Attention implementation. 研究通过两项小型输入扩展,将归一化softmax归约转化为支持任意有符号权重的高斯核求和,从而可直接使用现有Flash Attention代码执行。对于fp16且特征维度D > 8的任务,该方法在速度、内存开销与精度上超过编译后的PyTorch和PyKeOps内核,同时保持线性内存扩展。其优势在于继承成熟的GPU优化,但收益取决于维度、精度和可用的Flash Attention实现。

Quantum Computing 量子计算

Postprocessing Data Loss Distorts Quantum Neural Networks 后处理数据丢失扭曲量子神经网络结果

S. V. Panambalom, E. Altamura, N. Chancellor, et al.

arXiv:2609.05060 · 2026-09-04T12:22:13Z

A Qiskit SamplerQNN postprocessing assumption discards 85–99.6% of valid measurement shots when hardware bit strings span more than 100 physical qubits. On identical raw measurements, the resulting inference accuracy falls from 0.94 to 0.39, while the training-loss signal shrinks by 22–27× without an API warning. Tests on two IBM backends show that classical plumbing can silently dominate quantum-model quality, although this remains a case study of one software path. Qiskit SamplerQNN后处理中的一项假设,在硬件位串跨越100多个物理量子比特时会丢弃85%至99.6%的有效测量shots。对同一组原始测量数据,推理准确率因此从0.94降至0.39,训练损失信号则缩小22–27倍,且API没有发出警告。两台IBM后端上的测试表明,经典软件链路可能静默地主导量子模型质量,但这仍只是针对一条软件路径的案例研究。

Newsletter 邮件订阅

Daily semiconductor briefing. 每日半导体简报。