🎨Vision Language Model (VLM)
Also known as VLM, Vision-Language Model, Visual Language Model
An AI that can look at a photo. Then it tells you about it in words.
Think of it like
It is like a friend who can look at a photo with you. Then you can ask them what is in it.
Example
Emma sends a photo of a broken bike chain to a chat app and asks what is wrong. The model sees that the chain has come off the back gear and tells her how to put it back.
Why it matters
Much of the world is pictures, charts and screens, not text. A model that can see can help with all of them.
Definition
Common mistake
Key takeaways
- 1Sees and reads. Pictures and text.
- 2Image to tokens. Then read like words.
- 3Answers in text. Describe, read, explain.