Generative Model

Energy-Based Model (EBM)

ChatGPT introduced me to this, when i was trying to learn the different types of generative models.

LeCun has a tutorial on this:

• https://www.researchgate.net/profile/Marcaurelio-Ranzato/publication/216792742_A_Tutorial_on_Energy-Based_Learning/links/0912f50c6862425435000000/A-Tutorial-on-Energy-Based-Learning.pdf
• Video tutorial https://www.youtube.com/watch?v=BqgnnrojVBI
• NYU Lecture https://www.youtube.com/watch?v=tVwV14YkbYs&list=PLLHTzKZzVU9eaEyErdV26ikyolxOsz6mq&index=12 Learn unnormalized energy function: $p(x)\propto \exp (-E(x))$

EBMs: define a scalar energy for every configuration.

I hear mention of this through Meta’s lab work, and Diffusion Policy (i swear new york loves EBM or something).