Generalized Advantage Estimation

Heard from the spinning up

• “For a more detailed treatment of this topic, you should read the paper on Generalized Advantage Estimation (GAE), which goes into depth about different choices of \Phi_t in the background sections.”
• https://spinningup.openai.com/en/latest/spinningup/rl_intro3.html#id16

https://arxiv.org/pdf/1506.02438