📈Self-Supervised Learning
Also known as Self-Supervision
The data makes its own answers. The model guesses a hidden word, then checks.
Think of it like
Think of it like a word game. Hide one word in a book, then guess it. The book has the answer.
Example
A model reads the sentence 'The cat sat on the mat' with mat hidden. It guesses rug, checks against mat, and learns a little. It does this billions of times.
Why it matters
It is how today's big language and image models learn. They read huge piles of data that no one labelled.
Definition
Common mistake
Key takeaways
- 1Hide and guess. Cover part of the data.
- 2Data is the answer. No people needed to label.
- 3Scales up. Works on huge amounts of text.