Activation Function

Mish

$\mathrm{Mish}(x)=x\cdot \tanh (\mathrm{Softplus}(x))$

Resources:

• https://pytorch.org/docs/stable/generated/torch.nn.Mish.html