Generative Model

Diffusion Model

Add noise gradually and learn to reverse the process: $x_{t-1}={\alpha }_t(x_t-\gamma {ϵ}_{\theta }(x_t,t))+\mathcal{N}(0,{\sigma }_t^2)$. Can be interpreted as: $x^{\prime }=x-\gamma \nabla E(x)$

See DDPM for actual implementation detail notes. There’s also

Models

• DALL-E 2
• Stable Diffusion
• Imagen

Diffusion Models in Vision: https://arxiv.org/pdf/2006.11239.pdf

I worked on one for HackWestern.

• Stable Diffusion Animation: https://replicate.com/andreasjansson/stable-diffusion-animation/examples#nby3ut2bljhixb2gejkljmcib4