What do they mean by inductive bias here? Really it’s just model architecture

Citation

(Tay et al., 2022)

Tay, Y., Dehghani, M., Abnar, S., Chung, H. W., Fedus, W., Rao, J., Narang, S., Tran, V. Q., Yogatama, D., & Metzler, D. (2022). Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? https://arxiv.org/pdf/2207.10551