They compare:

• Semi-Gradient Algorithms
• Residual Algorithms

“Semi-gradient algorithms are fast but in general not convergent. Residual gradient algorithms are convergent but slow”

Citation

(Zhang et al., 2019)

Zhang, S., Boehmer, W., & Whiteson, S. (2019). Deep Residual Reinforcement Learning. https://arxiv.org/pdf/1905.01072