The word manifold sounds abstract and means something you have lived on your entire life. The Earth is round; your kitchen floor feels perfectly flat. Both are true. The surface of the Earth is a curved, closed shape — but any small enough patch of it is indistinguishable from a flat plane. A space with that property — every point has a neighborhood that looks like ordinary flat space — is a manifold. That is the whole definition. This section gives you three ways to hold it.
An ant walking a loop of wire can only go forward or back — one direction of travel, however wildly the wire coils through the room. Zoom in on the ant's neighborhood and the coiling disappears: up close, the wire is just a straight line. The wire is a one-dimensional manifold living inside a higher-dimensional room. The gap between those two numbers — the room's dimension and the wire's — is the whole reason the word exists.
You cannot draw the whole Earth on one flat page without lying somewhere — every world map distorts. But you can cover the Earth with an atlas: many overlapping flat pages, each honest about its own small region. That is actually the formal definition of a manifold — a space you can cover with flat charts — and the crucial property is what happens where two pages overlap: they describe the same territory, and they agree about it, up to each page's private choice of orientation. (If “private orientation, shared content” rings a bell, it should — it is the same move as the gauge idea in the gauge & holonomy primer, and it is why these two primers sit next to each other.)
The number of directions available in the flat patch is the manifold's dimension — and it belongs to the manifold, not to the room it sits in. Probe it:
Now the payoff for this site. When an essay says a transformer's computation lives on a low-dimensional coupling manifold, it means exactly this: the system's state is described by thousands of numbers — a point in a thousands-dimensional space — but the states it actually visits all lie on a thin curved surface inside that space, a surface with only a handful of directions of its own. The thousands of dimensions are the room; the manifold is the wire; the computation is the ant. Measuring the wire's dimension, and its shape — it turns out to be torus-like, holes and all, which is why section 1 matters — is what the coupling-manifold chapter and the shape chapter are doing.
Next: the counting section — what a loop can tell you about the space it lives in, and the three names that counting goes by.