Skip to content
BENIBIX Learn

Long Short-Term Memory (LSTM)

AI📈 Machine LearningNeural Networks

Also known as LSTM, LSTM Network

An RNN with gates that choose what to keep and what to forget.

Think of it like

Think of it like a notebook and a pen. You choose what to write down and what to cross out.

Example

Emma's app turns long voice notes into text. An LSTM keeps track of who is being talked about across many sentences.

Why it matters

It fixed the short memory of plain RNNs. That made voice helpers and translation apps much better.

Definition

Long short-term memory is a kind of recurrent neural network with a better memory. Inside each step, small gates decide what to keep, what to forget and what to pass on. This lets it hold on to facts for much longer than a plain RNN. It was the standard choice for speech and translation for many years. Transformers have since taken over most of those jobs.
The LSTM row adds gates to each box. They decide what the memory keeps and what it drops.

Common mistake

Picking an LSTM for a new text project out of habit. Transformers usually do better now, and they train faster.

Key takeaways

  1. 1
    A kind of RNN. It still reads in order.
  2. 2
    Gates. Keep, forget, pass on.
  3. 3
    Longer memory. Holds facts for longer.

Learn it properly