MechLens: Late Crystallization of Factual Knowledge Explains Intervention Effectiveness in Language Models
新研究发现LLM事实知识在最后几层突然“结晶”,而非逐层涌现,解释了为何干预后期层能有效减少幻觉。
arXiv:2606.07978v1 Announce Type: new Abstract: Understanding where LLMs store factual knowledge is critical for hallucination mitigation. We systemat…