Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model

Kevin mentions this was similar to pi0.

Citation

(Zhou et al., 2024)

Zhou, C., Yu, L., Babu, A., Tirumala, K., Yasunaga, M., Shamis, L., Kahn, J., Ma, X., Zettlemoyer, L., & Levy, O. (2024). Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Model. https://arxiv.org/pdf/2408.11039