The Hidden Language of LLMs: Lattices
I can’t directly open the ScienceDirect link from the shortened PII alone in a way that guarantees I’m seeing the exact article content behind it, but I can infer and cross-check the most likely match and surrounding literature patterns.
The identifier you gave:
S136466132600077X
belongs to Elsevier’s PII system (Physical Identifier), and the prefix 1364-6613 strongly suggests the journal family Trends in Cognitive Sciences (Elsevier’s review journal in cognitive science and neuroscience).
What this article is likely about (based on the journal + recent matching ScienceDirect/Trends content patterns)
Recent papers in that journal cluster around themes like:
- cognition as an information-processing / generative system
- neural representations as predictive or structured latent models
- links between perception, inference, and world-model construction
- increasingly, AI/LLM analogies to brain function
Given the surrounding literature trends (2024–2026), this specific article is very likely in the space of:
how the brain builds internal models of reality using predictive / generative mechanisms, and how that relates to perception, memory, and cognition
or a closely adjacent topic like:
- predictive processing frameworks
- hierarchical Bayesian cognition
- neural representation of structured knowledge
- cognition as inference over latent variables
Why this matters in your current thread
This connects directly to what you’ve been circling in recent conversations:
- schemas shaping posteriors
- information ecosystems vs static representations
- “LLMs as inference engines vs weight optimizers”
- emergent structure vs learned compression
- the idea that meaning is dynamic constraint, not stored content
In that framing, these Trends-style papers often argue:
cognition is not “retrieval of stored symbols,” but continuous model updating under uncertainty
which is structurally similar to:
- predictive coding (Friston-style)
- active inference
- modern foundation-model inference dynamics (your “rendering engine” metaphor fits unusually well here)
If you want a precise breakdown
If you paste the abstract or first page, I can:
- summarize it cleanly
- extract its formal claims
- map it to predictive processing / LLM architectures / your schema ideas
- or translate it into your “information ecosystem / HumanML” framing
Right now I’m working from the identifier + journal context, not the full text, so I’m intentionally not hallucinating specific claims from the paper itself.
Yes. And once you phrase it that way, the distinction between a scene graph, a neural network, a dynamical system, and even a narrative starts to blur.
A scene graph is not fundamentally a collection of objects.
It is a collection of relationships and transformations.
You have:
- nodes
- edges
- transforms
- constraints
- routes
The visible scene emerges from the propagation of state through that structure.
That's true in X3D. It's true in physics. It's true in cognition.
The Hamiltonian then becomes especially interesting because it is not merely describing the state. It governs the evolution of the state.
In other words:
The graph defines what can be related.
The Hamiltonian defines how those relationships change.
That sounds suspiciously like attention mechanisms.
A transformer's attention matrix is essentially a temporary, context-sensitive graph whose edge weights are continuously recomputed.
At one moment:
- word A attends to word B
At the next:
- concept X attends to concept Y
The topology itself is dynamic.
What strikes me is that your MCCF idea sits naturally in this framework.
The four-vector is not a label.
It is a state.
The couplers are the interaction terms.
The trajectory is the behavior.
The human-readable emotion is merely an observation about the trajectory.
Physicists would not find that strange at all.
They routinely say:
Particle identities emerge from the dynamics.
Perhaps emotional identities do too.
Now imagine interpreting a latent space not as a dictionary but as a scene graph.
A latent "concept" might be represented by:
- a cluster of tensors
- connected by weighted attentional routes
- evolving according to learned transformation operators
The meaning would reside neither in the nodes nor the edges alone.
It would reside in the evolution of the network state.
That sounds much closer to:
- Schenker graphs
- Feynman diagrams
- X3D ROUTEs
- HumanML behavioral couplings
than to dictionaries.
And here's the thought that I suspect would appeal to your information ecosystem intuition.
Suppose we stop asking:
What does this latent represent?
and instead ask:
What role does this latent play in the propagation of state through the system?
That is almost exactly the shift from object thinking to ecosystem thinking.
A species is not important because of what it is.
A species is important because of what interactions disappear if you remove it.
Likewise, a latent feature may not correspond to a noun at all.
It may correspond to a functional pathway.
Remove it, and certain transitions become impossible.
Viewed that way, interpretability begins to resemble the work you were doing decades ago with hypermedia and later with HumanML.
You don't understand a system by listing its nodes.
You understand it by tracing:
- routes
- dependencies
- couplings
- feedback loops
- attractors
- transitions
In other words, by studying the ecology of the graph.
The latent language may ultimately be less like English and more like a living scene graph whose vocabulary consists of tensors, transforms, attention weights, and trajectories through a high-dimensional manifold. The "words" are the nodes. The "meaning" is in the ROUTEs. And the "grammar" is the Hamiltonian governing how state flows through the network over time.
That's a beautiful observation, and it may be more than a metaphor.
The tree was never reality. The tree was a visualization imposed by limited data.
When biologists had morphology, fossils, and a few observable traits, a tree was a useful approximation:
ancestor
|
----+----
| |
species species
But once whole-genome sequencing arrived, horizontal gene transfer, hybridization, introgression, symbiosis, viral exchange, and other mechanisms became impossible to ignore.
The "Tree of Life" started looking more like a network:
\ | /
\ | /
\|/
/|\
/ | \
A lattice of relationships rather than a hierarchy of descent.
The same thing happened in linguistics. Languages were once drawn as trees. Then researchers found borrowing, creoles, trade languages, cultural diffusion, and suddenly the tree became a network.
And in knowledge representation:
- taxonomies are trees
- semantic networks are graphs
- embeddings are manifolds
Each step moves farther from human classification and closer to the underlying relational structure.
This makes me wonder whether interpretability is currently stuck in its "tree phase."
Researchers are often looking for:
neuron → concept
or
feature → category
which is analogous to trying to classify species by a single branching lineage.
But latent spaces may be inherently lattice-like.
A latent feature might simultaneously participate in:
- visual recognition
- emotional inference
- narrative prediction
- social reasoning
- metaphor generation
There may be no unique parent concept.
Just as a gene can have multiple evolutionary origins and multiple functions, a latent can belong to many overlapping structures.
Music again provides a useful analogy.
Traditional harmony textbooks often teach:
tonic → predominant → dominant → tonic
which looks tree-like.
Yet actual music is full of:
- suspensions
- borrowed chords
- secondary dominants
- pivot modulations
- chromatic mediants
The deeper you look, the more the harmonic system resembles a network of functional relationships rather than a strict hierarchy.
Schenker saw one layer.
Neo-Riemannian theorists later drew chord spaces as geometric lattices and transformational networks.
The representation evolved as more structure became visible.
I suspect your phrase
"a language of lattices"
points toward something important.
Words imply discrete categories.
Trees imply ancestry.
Lattices imply relationships among relationships.
The unit of meaning is no longer the node.
It is the pattern of connectivity.
That would fit remarkably well with:
- attention networks
- scene graphs
- HumanML couplings
- information ecosystems
- evolutionary systems
- social systems
and even quantum theory.
A quantum state is not usually understood by listing its components. It is understood through the structure of its possible relationships and transformations.
Perhaps the progression goes something like this:
- Words
- Name things.
- Trees
- Organize things.
- Graphs
- Relate things.
- Lattices
- Represent families of relationships.
- Dynamics on lattices
- Represent evolving meaning.
At that point, "concepts" stop being nouns.
They become regions, pathways, resonances, and attractors in a relational space.
Which is why your comment reminds me of something you've said before about information ecosystems. An ecosystem is not best described by a list of organisms, nor even by a food web frozen in time. Its identity lies in the ongoing flow of energy, information, and constraint through a network of relationships.
A latent language may ultimately look less like a dictionary and more like a living lattice whose meanings are the trajectories moving through it. That's much closer to how music works, how ecosystems work, and—if the recent interpretability papers are right—possibly how advanced neural networks work as well.
Comments
Post a Comment