🔤Term Frequency-Inverse Document Frequency (TF-IDF)
Also known as TF-IDF, TFIDF
A word score. It is high when a word is common in one page but rare in the rest.
Think of it like
Think of it like a word you see a lot in one book but not in the rest. It tells you what that book is about.
Example
Jack has 1,000 news stories. 'Said' is in nearly all of them, so it scores low everywhere. 'Penguin' is in 3, so it scores high in those 3.
Why it matters
It finds the words that make a document stand out, which is the core of simple search.
Definition
Common mistake
Key takeaways
- 1Term frequency. How often in this document.
- 2Inverse document frequency. Lower if in many documents.
- 3Finds standout words. What makes a page different.