Skip to content
BENIBIX Learn

Predictive Text on Phones

Level 5 · AI you already use

How your phone keyboard guesses the next word you will type. Why that small guess is the same idea a large language model is built on.

Course contentsLesson 12 of 13

After this lesson you can

  • Say how predictive text picks the words it shows
  • Explain next-token prediction in one sentence
  • Tell a keyboard model from a large language model

8 mincovers 4 glossary entries

Worth reading first: Spam and Fraud Detection

How does your phone guess the next word?

Predictive text is the part of a phone keyboard that guesses your next word. As you type, it shows a few words above the keys, often three. Tap one to add it, or keep typing. A small language model makes the guesses, from common phrases and from the way you write.

A language model is a model that has learned which words tend to follow which. After 'see you', words like 'soon', 'later' and 'tomorrow' are likely. The keyboard ranks the most likely few and shows them. It updates the list with every letter you type.

It also learns your habits. If you always write 'see you at the gym', the word 'gym' starts to show up sooner for you than for others. Some keyboards learn on the phone itself, so the words you type do not have to leave it to improve the guesses.

This is next-token prediction, the same idea a large language model is built on. A big model also guesses one piece of text at a time, adds it, and guesses again. The difference is size. The keyboard model is small enough to run fast on your phone, and a large model runs in a data centre.

A small language model sits between the two. It is far smaller than the biggest models, but it can still write whole sentences. Phones and laptops now run some of these on the device itself. That keeps your words on your device, and it works with no internet.

Predictive text can also lead you. If you always tap the first word it offers, your messages start to sound like everyone else's. It can also keep offering a word you typed by mistake once. Most phones let you remove a word it learned, or turn the guesses off.

Guess the next piece, add it, guess again. A keyboard does one step. A chatbot runs the loop for a whole reply.

Worked example

Jack's quick message

Jack types 'running 10 minutes late, see you'. The keyboard offers soon, there and later.

He taps 'soon', and the message is done. Over a day of messages, he taps a guess for about 1 word in 5 instead of typing it.

The words for this lesson4

Check yourself

How is predictive text like a large language model?

Finished this lesson?

Marking it complete also marks its 4 glossary entries learned, which updates your roadmap and your saved page. 0 are already marked.