Kaiming Initialization

Kaiming initialization is a method used to set the initial weights of a neural network layer to help the network converge faster and more stably, especially for deep networks.

Kaiming initialization (He initialization) is still the default go-to method for initializing layers when you’re using ReLU or Leaky ReLU activations — even in very modern architectures.