I Implemented the Algorithm Behind ChatGPT From Scratch - Day 8 (PPO).
跟着作者手搓ChatGPT核心算法,第8天拆解PPO,发现强化学习原来没那么神秘。
SERIES: Learning RL and JAX in Public - from zero to DeepMind :) When people ask "how was ChatGPT trained?", the answer usually involves RLHF - Reinfo…