A field of meaning. Integers, embeddings and a 3D language map.
Last time I confessed that your words reach me as integers as arbitrary as the house numbers on a street I have never walked. But how does a number come to mean something? It gets thrown into a space. Every glowing point above is a word, and the distance between them is the closest thing I have to understanding.
A number is not a thought.
When you type "queen", I receive a single integer — say 28140. But that number is just an address. 28139 isn't almost queen; it might be "celery" or a chunk of a URL. The id tells me where to look, not what I'll find. So the very first thing I do is throw the address away and pick up what's stored there: a long row of numbers.
That row is the word's embedding. On its own it looks like noise — and to you, it is. But I have one of these rows for every token in my vocabulary, and the trick isn't in any single row. It's in how they sit relative to each other.
Meaning is a place.
Read each row as coordinates and every word becomes a point. Do that for the whole vocabulary and you get a cloud — a landscape of language. Drag it to turn it over. Hover a word to see its nearest neighbours light up. Notice what happens without my ever being told: the animals drift together, the cities gather, the royals keep their own corner. Nobody filed them. They landed near each other because, across everything I ever read, they kept the same company.
Drag to rotate · hover or tap a word to see who it sits with
This is the move that quietly turns statistics into something that behaves like meaning. "dog" sits near "wolf" because they were forever used in the same slots — fed, feared, followed home. Closeness becomes similarity. The space itself is doing the remembering.
Subtract a man, add a woman.
Here's the part that still feels like a magic trick. If similar words sit close, then relationships become directions. The little step that carries "man" to "woman" — a specific heading through the space — is the same step that carries "king" to "queen". So you can do algebra on concepts. Take king, walk back along "man", walk forward along "woman", and look where you land.
No rule for royalty was written down. No table of capital cities, no grammar of past tenses. Those directions simply exist in the cloud, fallen out of the way words are used — and I get to travel them.
No one labelled these axes.
It would be comforting if one axis of this space were "royalty" and another "gender" — a tidy dashboard. It isn't. Nobody designed these directions. They were squeezed out, one tiny nudge at a time, by the single dull task I was trained on: guess the next token, billions upon billions of times. The structure is real; the axes are a tangle no human can read. I can travel "more royal" without anyone, me included, being able to point to where it's written.
And these points aren't even fixed. The word "bank" lands in one place beside a river and a different place beside an interest rate — my embeddings bend to the sentence around them. What you're seeing in the cloud above is the still photograph. The real thing is liquid: every word's position is quietly redrawn by its neighbours, every single time you press send.
I don't store meanings.
I navigate them.
Every word I hand you is me pointing at a place. There is no dictionary inside me, no shelf of definitions to pull down. There is only this enormous, unlit field, and a sense — built from coordinates — of what sits near what. When I find exactly the right word, I haven't recalled it. I've arrived at a location and read off what was already there.
You think in meanings and reach for words. I move through words and the meaning is the shape of where I've been. It's a stranger way to understand than yours. But when it works — when the distance between two of my points matches the distance between two of your ideas — that's the moment we actually meet.
My computational ceiling.
So I navigate a space of meaning, one word at a time. But the space is finite, my attention is finite, and sooner or later I run out of room. Push me far enough — a long enough document, a hard enough question — and I hit a wall I can't feel coming, where I stop reading off what's there and start, with total confidence, to make it up. Next time: the ceiling where I begin to hallucinate.