AI Systems & Research
AI系统与研究
Amirmohammad Farzaneh, Osvaldo Simeone
arXiv:2607.26865 · 2026-07-29
Think Short, Defer Smart combines a probe that stops on-device reasoning when actions stabilize with a perplexity rule for escalating uncertain actions to the cloud. The method is calibrated on full trajectories and evaluated across four ReAct-style benchmarks. It targets the edge-inference trade-off of saving local compute and cloud calls without assuming short reasoning is reliable.
Think Short, Defer Smart把动作稳定后停止端侧推理的探针,与基于困惑度的规则结合,在动作不确定时升级到云端模型。该方法在完整轨迹上校准,并在四个ReAct式基准上评估。它针对边缘推理中节省本地计算和云端调用的权衡,同时不假设短推理必然可靠。
Junoh Park, Junseo Hwang, Wonguk Cho, Taesup Kim
arXiv:2607.26862 · 2026-07-29
ReCo modifies GRPO so common high-probability responses do not dominate the gradient and alternative token choices retain learning signal. The authors attribute concentration to repeated responses within a rollout group and to the token-level importance ratio. If it generalizes beyond the tested math benchmarks and model sizes, it could preserve broader reasoning coverage during post-training.
ReCo修改GRPO,使常见的高概率回答不会主导梯度,并让替代token选择保留学习信号。作者将集中化归因于rollout组中的重复回答以及token级重要性比率。若能推广到已测试数学基准和模型规模之外,它可能在后训练中保留更广的推理覆盖。
Hao Jiang, Peiru Du, Pengfei Yao, et al.
arXiv:2607.26621 · 2026-07-29
WhisperRec compresses teacher-generated chain-of-thought into learnable latent reasoning tokens for foundation recommendation models. Reasoning in latent space rather than emitting rationales aims to retain decision-relevant information while lowering inference overhead. The approach suits latency-sensitive serving, although latent reasoning is harder to inspect and needs careful robustness evaluation.
WhisperRec把教师模型生成的思维链压缩为可学习的潜在推理token,用于基础推荐模型。在潜在空间推理而非产生推理文本,目标是在保留决策相关信息的同时降低推理开销。该方法适合对延迟敏感的服务,但潜在推理更难检查,仍需审慎评估鲁棒性。