Characterizing Narrative Content in Web-scale LLM Pretraining Data
详解LLM预训练数据中的叙事篇章特征,揭示模型如何理解和生成故事结构,对改进训练数据质量有重要启示
arXiv:2606.19468v1 Announce Type: new Abstract: The narrative composition of web-scale LLM pretraining corpora remains largely unexplored even though …