The Context Window — Why the Desk Has Edges

Lesson 3 · taught by Pip · free preview

Last lesson we said context is what's on the AI's desk. Now for the part that explains most "it forgot!" moments: that desk has edges. It can only hold so much at one time. This limit has a name — the context window — but you don't need the jargon, just the picture.

Here's the plain idea: an AI can pay attention to a certain amount of conversation at once. When you go past that amount, the oldest parts slide off the edge of the desk to make room for the new. They're not hidden in a drawer for later — within that conversation, they're simply gone.

A whiteboard that's only so big

Forget the desk for a second and picture a whiteboard. You and the AI are writing on it together as you talk. Your questions, its answers, all of it goes up on the board.

The board has a fixed size. As the conversation grows, it fills up. To write anything new, something old has to be erased — and it erases from the top, the oldest stuff first. So an hour into a long chat, the friendly detail you mentioned at the very start may have been wiped to make room for everything since.

That's why a long conversation can start strong and then "forget" how it began. Nothing went wrong. The board just filled up, and the beginning got erased.

Two very different kinds of forgetting

This is the distinction the whole course hinges on, so let's make it crisp:

• Within one conversation: the AI remembers everything — until the window fills up. Early on, it's got the whole chat on the board. Very late in a long chat, the opening lines may be gone.
• Between two conversations: the AI remembers nothing. New chat, fresh board, blank slate. (That's lesson 1's forgetting — on purpose.)

So there are two forgettings, and they have different causes. One is the board running out of space mid-conversation. The other is starting a brand-new board. Knowing which one you're hitting tells you how to fix it.

Why this matters for your business

If your team uses AI in long back-and-forth sessions, watch for the board filling up:

• Drop the most important facts and instructions near where you need them, not just once at the very beginning of a marathon chat.
• For a big task, it's often better to start a fresh conversation with a clean, well-stocked board than to keep piling onto a bloated one where the early instructions have already been erased.
• If the AI suddenly "forgets" something you said an hour ago in the same chat, that's the window — not a glitch. Just say it again.

The good news: the boards keep getting bigger every year, so this bites less than it used to. But it never disappears entirely, and knowing it exists is what separates a frustrated user from a fluent one.

Your turn

Next time you're deep in a long AI conversation and it seems to lose the thread, don't start over in a huff — just restate the key fact right then and there. Watch it snap back into line. You've just managed the window like a pro.

🔦 You now know the desk has edges and why long chats forget their own beginnings. Next, the bigger reset: why every brand-new conversation starts from zero.