LLM-based Embeddings: Attention Values Encode Sentence Semantics Better Than Hidden States
研究发现LLM中注意力值比隐藏状态更能编码句子语义,挑战传统embedding范式
arXiv:2602.01572v2 Announce Type: replace Abstract: Sentence representations are foundational to many Natural Language Processing (NLP) applications. …