Why Should I Trust You, Bellman? The Bellman Error is a Poor Replacement for Value Error

Ok i thought this paper had big implications, but it feels more minor after reading it. The bellman equation is a surrogate of how much the value function is actually off (this is measured via the full return $G_t$).