Vision-Language Model (VLM)

Resources

• https://huggingface.co/blog/vision_language_pretraining

Models

• PaliGemma
• LLaVA
• Google Gemini

For example, Prismatic VLM.

In robotics, we fine-tune these VLMs to make VLAs.