FineInstructions: Scaling Synthetic Instructions to Pre-Training Scale
通过合成指令数据扩展预训练规模,突破传统监督训练数据瓶颈的新方法
arXiv:2601.22146v2 Announce Type: replace-cross Abstract: Due to limited supervised training data, large language models (LLMs) are typically pre-trai…