Training nGPT
把 Transformer 参数与激活约束到超球面,nGPT 带来表示学习新范式,一文看懂归一化训练的关键设计。
arXiv:2608.01284v1 Announce Type: cross Abstract: The normalized Transformer (nGPT) realizes hyperspherical representation learning by constraining mo…
把 Transformer 参数与激活约束到超球面,nGPT 带来表示学习新范式,一文看懂归一化训练的关键设计。
arXiv:2608.01284v1 Announce Type: cross Abstract: The normalized Transformer (nGPT) realizes hyperspherical representation learning by constraining mo…
AutoML管道如何挑选损失函数与优化器最佳搭档?这项研究为NNGPT系统找到了稳定训练的配对规律
arXiv:2606.20933v1 Announce Type: new Abstract: The choice of loss function and optimizer is an important decision, that shapes further model training…
深入评估PlanGPT性能指标,与专业规划器对比,揭示大模型在规划任务中的真实表现与差距。
arXiv:2606.10489v1 Announce Type: new Abstract: Automated Planning is a subfield of Artificial Intelligence (AI) where the main objective is generatin…
统一大运动语言模型,多模态控制下的运动生成与理解新突破
arXiv:2410.21747v2 Announce Type: replace Abstract: Generating lifelike human motions from descriptive texts has experienced remarkable research focus…