🔤Word Embedding
Also known as Word Vector, Word2Vec
Each word as a list of numbers, so words with close meanings sit close.
Think of it like
Think of it like a map where words that mean close things live on the same street.
Example
Lucy's search tool uses word embeddings. A search for 'car' also finds pages that only say 'vehicle', because the two vectors are close.
Why it matters
Embeddings let a computer tell how alike two words are. The language models of today are built on this idea.
Definition
Common mistake
Key takeaways
- 1A vector per word. A few hundred numbers.
- 2Close means alike. Cat sits near dog.
- 3Learned from text. Not chosen by hand.