Online Data Selection for Instruction Tuning via Gaussian Processes
用高斯过程在线筛选指令微调数据,让大模型训练从拼数量转向拼质量,值得一读。
arXiv:2606.30077v1 Announce Type: new Abstract: With Large Language Model (LLM) pre-training and fine-tuning shifting its focus from data volume to da…