1
Faster AI training by quietly cloning the model
用推测解码的思路让训练加速:小模型打草稿、大模型只做校验,改下训练流程就能省下大量算力。
A new paper introduces a method to speed up reward-based fine-tuning by having the model generate a cheap, compressed copy of itself to draft text, wh…