Backup Diagram

• Backup digrams display relationships that form the basis of the update or backup operations that are at the heart of reinforcement learning methods.
• These operations transfer value information back to a state (or a state–action pair) from its successor states (or state–action pairs)

Example of a Backup Diagram: