shrevia.com / tn-002

TN-002 · Note two of three

A lattice,
not a ladder.

86 billion neurons in a three-dimensional network, operating under no single governing formula — and capability acquired without an optimisation procedure of any kind.

Series Notes toward AGI Ideas 07 Previous TN-001 Next TN-003

01 — PremiseThe Question of Scale

The human brain outperforms every artificial system yet constructed. The operative difference is not the quantity of its components but the manner in which those components are connected.

The brain contains on the order of 86 billion neurons, each capable of simultaneous connection to many others. The figure is cited often enough to have lost its force, and on its own it settles little: artificial networks also comprise very large numbers of units with dense connectivity. What follows concerns the properties the count does not capture.

02 — ConstraintRepresentational Ceilings

Consider a constrained encoding. Asked to enumerate three-digit numbers, one produces at most a thousand — 000 through 999 — regardless of effort or duration. The ceiling is a property of the representation, and it is fixed before any work begins.

A quantum system is not bounded in the same way. A qubit in superposition represents multiple states concurrently, and for certain problem classes this permits traversal of state spaces a fixed-width classical encoding cannot enumerate. The advantage is representational rather than a matter of operating faster.

A fixed representation determines the ceiling of what can be represented, independently of scale or effort. TN-002 · §02, representational ceilings

This is the lens for what follows. Where a system's reach is bounded, the bound is usually located in the representation rather than in the quantity of computation applied to it.


03 — ArchitectureTopology

Artificial networks also connect each unit to many others, so connection count is not the distinguishing property. The distinguishing property is the set of directions in which those connections are permitted to carry signal.

Biological neurons form a densely interconnected three-dimensional network. A signal does not advance to a designated next layer and then to the one after it; it interacts in many directions concurrently, including back into the regions that produced it.

A transformer is sequential by construction: representations traverse a fixed stack in a fixed order. A biological network carries no equivalent ordering constraint. This difference in topology, rather than any difference in scale, is where the architectural gap is located.

fig. 03 The same signal, in two architectures
Left, one direction is permitted. Right, one firing reaches the whole structure at once.

04 — ProcessThe Absence of a Governing Formula

A second difference compounds the first. Biological information processing is not the repeated application of a single mathematical operation.

The contrast is visible in the pipeline. Frontier systems are transformer-based, so input is converted to tokens — numerical representations — over which the model performs a large number of arithmetic operations to produce an output. In a language model that output is generated one token at a time, and a tokeniser converts the result back to text. Each stage is the same class of operation applied again.

Biological processing has no corresponding stage. It is a heterogeneous system in which neuronal activity, electrical dynamics, feedback mechanisms and numerous interacting processes operate concurrently and upon one another.

Artificial networks are defined by their mathematical operations and are therefore bounded by them. The absence of a single governing formula — as much as the additional connectivity — is what affords the biological system latitude the artificial one does not have.


05 — AcquisitionLearning Without an Optimiser

The most consequential difference lies in how capability is acquired. Teaching a child requires no fixed rule set and no optimisation procedure of the kind used to train a model.

A child observes, then attempts to reproduce what it observed. That is the method in full.

An infant cries when hungry and also when tired, but varies its expression across the two cases, and a caregiver distinguishes them reliably. No labelled dataset exists for this. The signal is generated by the child and interpreted by the adult, and the arrangement is effective.

The infant did not begin with a model of the world, or of how others would respond to it. It acquires one gradually through interaction with its environment, and that interaction is itself the training process.

An action produces a response; the response updates the internal model; the updated model produces a new action. The process does not terminate:

fig. 04 The loop that never closes
EXPERIENCE RESPONSE LEARNING NEW ACTION NEW EXPERIENCE learning
Experience → Response → Learning → New Action → New Experience. No optimiser anywhere in it.

Cognition, on this account, is not the product of computation alone.

Learning is continuous and drawn from direct experience, and what it produces is an internal model of the environment rather than a record of it. Inputs are multimodal — vision, hearing, olfaction, touch — and they generate affective states, memories and other persistent internal conditions that shape subsequent processing.

A decision is then formed by combining those with prior experience, current context, learned regularities and active goals.

Cognition in a biological system is therefore not reducible to sequence prediction. TN-002 · §05, learning without an optimiser

The system models its environment, learns from interaction with it, retains that learning, and applies it to later decisions. These are four distinct capabilities operating concurrently, none of which is prediction.


06 — RequirementsRequirements for a Successor Architecture

Matching this will require substantive modification of transformer-based architectures, or the development of new ones. The change is not an increase in scale. It is the removal of the representational constraint set out in §02, and the addition of the following capabilities:

  • R.01Interaction with data rather than consumption of it — the system acts on its input and observes the result.
  • R.02Concurrent multimodal processing — inputs resolved as a single situation, not serialised into one sequence.
  • R.03Connection to memory and prior experience, as a first-class structure rather than an appended retrieval step.
  • R.04Continuous learning from environmental feedback, without a separate training phase.
  • R.05Application of the model it has constructed to subsequent decisions and outputs.
Position of this note

A successor architecture should not be a next-token prediction system. It should perceive, model, retain, infer and learn, and interact continuously with its environment.

Its outputs should follow from the model it has constructed, rather than from the statistical continuation of a sequence.

Granting that requirement raises the next question directly: whether a system of that kind could improve itself without human intervention at each step. That is the subject of TN-003.