Log-Derivative Trick

Remember that

$\nabla \log f=\frac{1}{f}\nabla f$ We can rewrite this as $\nabla f=f\nabla \log f$

• This is used the derive the original Policy Gradient Methods formula