Depth-Entropy Guided Sampling for Training-Free LLM Reasoning
无需训练的LLM推理新方法:深度熵引导采样,提升推理效率与质量。
arXiv:2607.09693v1 Announce Type: cross Abstract: Reinforcement learning (RL) has become the dominant paradigm for improving the reasoning capabilitie…
无需训练的LLM推理新方法:深度熵引导采样,提升推理效率与质量。
arXiv:2607.09693v1 Announce Type: cross Abstract: Reinforcement learning (RL) has become the dominant paradigm for improving the reasoning capabilitie…
全国航空科技双创顶级赛事,免费报名通道已开启,参赛者速览!
熵引导多token预测方法,加速LLM推理并提升生成质量。
arXiv:2606.27550v1 Announce Type: cross Abstract: Multi-token prediction has been shown to increase data density during training, improve downstream t…
利用中间层熵的动态变化检测大模型越狱,为AI安全提供新思路。
arXiv:2606.25182v1 Announce Type: cross Abstract: Jailbreak attacks reveal a persistent weakness in aligned Large Language Models: carefully crafted p…
ICML 2026 研究揭示:监督微调过度训练会通过熵塌陷导致强化学习下模型输出排名反转,对齐策略需要警惕。
arXiv:2606.18487v1 Announce Type: new Abstract: The standard heuristic of selecting the SFT checkpoint with the highest pass@1 for GRPO can fail when …
揭示Grokking中权重范数如何通过交叉熵下的logit尺度中介作用控制延迟泛化,为理解神经网络泛化机制提供新视角。
arXiv:2606.18465v1 Announce Type: new Abstract: Grokking, the delayed jump from memorization to generalization, is usually tied to the weight norm: a …
结合局部与全局熵的新方法,提升大模型不确定性量化精度,值得关注。
arXiv:2606.09875v1 Announce Type: cross Abstract: Large language models hallucinate confidently, making uncertainty quantification (UQ) essential for …
去噪Transformer与熵编码结合,突破有损文本压缩瓶颈,兼顾压缩率与语义保留。
arXiv:2606.08184v1 Announce Type: new Abstract: Lossy text compression reduces data size while preserving core meaning, making it well-suited for summ…
多智能体LLM协调稳定性新方案:熵正则化均衡选择,突破传统博弈论限制。
arXiv:2606.08068v1 Announce Type: new Abstract: Multi-agent large language model (LLM) systems often fail to reliably outperform a single strong model…
揭示LLM不仅是下一个token预测,而是具备前瞻规划的通用模拟器,颠覆认知。
Article URL: https://invertedpassion.com/llm-are-universal-simulators/ Comments URL: https://news.ycombinator.com/item?id=48449409 Points: 1 # Comment…
提出快速自适应语义熵方法,用于多智能体代码生成场景下提升代码质量,有望推进自主软件开发。
arXiv:2606.09800v1 Announce Type: cross Abstract: Multi-agent code generation offers a promising paradigm for autonomous software development by simul…
从信息熵视角揭示多智能体协作的成败关键,为LLM系统设计提供理论依据
arXiv:2602.04234v6 Announce Type: cross Abstract: Multi-agent systems (MAS) have emerged as a prominent paradigm for leveraging large language models …
提出Policy Split方法,用双模式熵正则化激励LLM强化学习中的探索,平衡探索与利用。
arXiv:2604.11510v2 Announce Type: replace-cross Abstract: To encourage diverse exploration in reinforcement learning (RL) for large language models (L…
ICML2026接收论文,用熵动力学揭示Chain-of-Thought推理的深层机理,为理解大模型思维链过程提供新视角。
arXiv:2606.02020v1 Announce Type: cross Abstract: This paper investigates the entropy dynamics of Chain-of-Thought (CoT) and uncovers a consistent two…
医学影像AI新方案:用熵最小化避免模型崩溃,精准降低预测偏差
arXiv:2606.02339v1 Announce Type: new Abstract: Entropy minimization (EM) is the dominant objective for test-time adaptation, yet its failure mode, mo…
从熵动力学新视角解析LLM多智能体系统的协调者识别机制,揭示系统涌现行为。
arXiv:2606.01351v1 Announce Type: new Abstract: The transition from single-turn models to Multi-Agent Systems (MAS) promises enhanced problem-solving …
Soft-NBCE提出熵加权块融合方法,有效提升模型对长文本的处理能力,为长上下文建模提供新思路。
arXiv:2606.01101v1 Announce Type: new Abstract: The quadratic complexity of self-attention remains a bottleneck for Large Language Models (LLMs) proce…
提出Float8@2bits方法,用熵编码在无数据场景下高效压缩模型,性能几乎无损。
arXiv:2601.22787v2 Announce Type: replace Abstract: Post-training compression is currently divided into two contrasting regimes. On the one hand, fast…
基于信息熵的智能变速播放工具,自动跳过低信息片段,提升听觉效率。
Article URL: https://github.com/patrickxia/entropic Comments URL: https://news.ycombinator.com/item?id=48346255 Points: 4 # Comments: 1
提出功能熵方法,通过不确定性量化预测LLM生成代码的功能正确性,为代码可靠性评估提供全新视角
arXiv:2605.28500v1 Announce Type: cross Abstract: Large language models have shown impressive capabilities in code generation, yet they often produce …