Linear Projection

You’ll see this for example in PaliGemma, that linear projection is just a matrix multiplication to change from. one dimensionality to another dimensionality.

• A linear layer projecting SigLIP’s output tokens into the same dimensions as Gemma2B’s vocab tokens, so they can be concatenated.