RNNs and Sequence Models309 · Module I · Lesson 02 of 3
Article · 12 min

LSTMs and GRUs

The gates that fixed it.

Summary

The gates that fixed it. This lesson sits inside Module I — The RNN family — of RNNs and Sequence Models, the course that anchors the Applied Machine Learning program. It is not a survey; it is the specific, working understanding of "LSTMs and GRUs" that the rest of the course assumes you carry forward.

Objectives
  • 01Define LSTMs and GRUs in the precise sense used across RNNs and Sequence Models.
  • 02Recognize when LSTMs and GRUs is the correct lens for the situation in front of you, and when it is not.
  • 03Apply LSTMs and GRUs to a concrete case drawn from The RNN family, and defend the result in plain language.
  • 04Connect LSTMs and GRUs to the adjacent lessons in this module without collapsing the distinctions between them.
The Lesson

The idea, stated plainly

The gates that fixed it. That single sentence is the whole lesson in compressed form. The rest of the reading unfolds it — what it means when the terms are taken seriously, where it comes from, and what work it does inside RNNs and Sequence Models. Read the sentence, then read it again after the sections below; it should carry more weight the second time.

Why it belongs in The RNN family

Module I exists because the classical sequence models. "LSTMs and GRUs" is one of the pillars of that module: without it, the later lessons either become memorization or lose their bite. Notice which earlier lessons this one leans on, and which later lessons will lean on it — the shape of the module is easier to see once you place this piece.

How the School of Artificial Intelligence faculty use it

In practice, working school of artificial intelligence professionals reach for this idea before they reach for a formula or a tool. It is a way of framing the problem so that the right question comes first. The mark of understanding is not that you can recite LSTMs and GRUs; it is that you catch yourself using it, unprompted, when the situation calls for it.

Common misreadings

The most frequent error is to treat LSTMs and GRUs as a slogan and skip the mechanics. The second most frequent is the opposite — treating the mechanics as the point, when the mechanics are only there to make the idea usable. Both errors collapse the same distinction, and both are correctable by returning to the one-line summary and asking what it actually claims.

Key Ideas
  • LSTMs and GRUs is a working tool, not a slogan.
  • Its meaning is set by the module it lives in: The RNN family.
  • Understanding is demonstrated by unprompted use in the correct situation.
  • The adjacent lessons in this module are its natural context; read them together.
References
  • 309 — RNNs and Sequence Models, Module I: The RNN familyThe parent module for this lesson. Re-read the module blurb after finishing the lesson.
  • The Anabasis Academy — School of Artificial Intelligence, Applied Machine LearningThe wider program this lesson serves; the Certificate in Applied ML (Practitioner tier). credential ultimately certifies mastery of ideas like this one.