RoBERTa: A Robustly Optimized BERT Pretraining Approach

RoBERTA

This is just training BERT on more images.

Citation

(Liu et al., 2019)

Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. https://arxiv.org/pdf/1907.11692