Latent Diffusion Model (LDM)

How is this different from your average diffusion model? Oh wow I have no idea about latent diffusion models, they’re the standard now.

The idea is quite simple, you go through encoder, do diffusion in latent space, and then decode this.

• The idea is that diffusion is a very expensive process, but encoding / decoding is much faster