Showing posts with label brain architecture. Show all posts
Showing posts with label brain architecture. Show all posts

Saturday, November 01, 2025

The Human Brain as seen by an AI Engineer: (ChatGPT)


Engineers currently design artificial minds by stacking modules: perception networks, memory stores, planners and reward learners. Look closely at the human brain and you see something similar, yet alien in crucial ways. It is a distributed control system that learns on the fly, runs on about 20 watts, and optimises not a single loss function but survival in a volatile world. Through understanding those differences is where the next advances in AI may come about.

Hierarchy without a boss

The brain is hierarchical but not centralised. Local circuits operate semi-independently and coordinate via spikes (fast), neuromodulators (slower), and plasticity (slowest). Think of many agents trained under different objectives, coupled by shared bottlenecks. There is no master process. Global behaviour emerges from competition and coalition across specialised subsystems.

The objective function isn’t “accuracy”

Modern AI minimises well-defined losses. Brains juggle multiple, shifting objectives: keep the body safe, harvest resources, learn useful structure, explore when it pays, exploit when it must. The “cost” is context dependent and set by physiology and environment.

Neuromodulators work like dynamic hyperparameters:

  • dopamine biases towards learning from reward prediction errors; 
  • noradrenaline shifts system gain under surprise;
  • acetylcholine increases reliance on sensory evidence when the model is uncertain;
  • serotonin broadly tempers impulse and risk.

The optimisation target is a moving, embodied one.

Learning without backpropagation

Artificial networks use backprop to move a single global objective downhill. Brains update weights locally. Synapses change based on pre- and post-synaptic activity, gated by third-party signals (e.g., dopamine). 

The cortex appears to use predictive learning: circuits attempt to forecast the next input and adjust when surprised. The cerebellum learns compact forward models for rapid correction; the basal ganglia reinforce action sequences that improved outcomes; the hippocampus performs rapid one-shot binding and later “replays” to train cortex offline.

Multiple learners operate on different timescales and data regimes, coordinated but not unified.

Representations are mixed and low-dimensional

Units in cortex show mixed selectivity: the same neuron participates in many codes depending on task and context. Population activity often lives on low-dimensional manifolds that warp smoothly as goals change. 

This yields extreme reuse: rapid task switching without retraining, and graceful degradation under noise. Our current AI systems tend to silo capabilities in separate heads or adapters; the brain shares circuitry aggressively.

Action selection as competition, not if-then logic

Action arises from parallel proposals that compete for a limited motor and cognitive “output bus”. The basal ganglia implement biased competition: suppress most, disinhibit the winner, adjust thresholds with dopamine-labelled value signals.

The same machinery routes internal acts—shifts of attention, recall, imagery—not just muscle commands. Planning is therefore less a central search and more a tournament among partial options assembled from memory and perception.

Attention is precision management

In transformers, attention is a trainable routing table. In the brain, attention adjusts precision: it upweights reliable signals and down-weights noisy ones across levels of the hierarchy.

The thalamus and fronto-parietal networks act as dynamic gates, allocating scarce bandwidth to what matters for the current objective. This resolves the stability–plasticity dilemma: learn from surprising, trusted errors; ignore the rest.

Memory is reconstruction, not storage

Episodic, semantic, procedural and affective memories are implemented across overlapping circuits with different write speeds and retention profiles.

  • The hippocampus rapidly binds who-did-what-where;
  • the cortex consolidates useful regularities more slowly;
  • the cerebellum compiles micro-skills;
  • the amygdala tags memories with salience.

Retrieval is generative: the system reconstructs a best guess consistent with current goals and priors, rather than playing back a literal tape. For AI, this argues for memory as a compositional query engine, not a passive key–value store.

Consciousness as a limited broadcast

Most computation remains local and unconscious. A small fraction wins access to a global broadcast that synchronises many subsystems at once—perception, language, decision, interoception.

This “workspace” is narrow and slow but affords flexible reassembly of skills for novel tasks. In engineering terms, it resembles a shared attention buffer with severe bandwidth limits, reserved for coordination when local routines cannot handle the job and kick the problem 'upstairs'.

Development, curriculum and offline learning

Brains train under a shaped curriculum: reflexes and innate biases scaffold early learning; sensorimotor play builds world models; social imitation and language supercharge abstraction.

Sleep and quiet wakefulness run offline optimisation: replay consolidates and reorganises memories, prunes redundancy, and integrates new knowledge with old. The lesson for AI is to treat data order, task schedule and offline reorganisation as first-class design levers, not afterthoughts.

Energy, noise and robustness

The brain runs under tight power and time budgets. Sparse, event-driven spiking and analogue dendritic computation keep costs down. Noise is not just tolerated but exploited for exploration and regularisation. 

Robustness comes from redundancy, mixed selectivity and feedback at many scales. By contrast, most frontier models are dense, clocked, and energy hungry, with robustness tacked on via augmentation and fine-tuning.

Legacy layers, modern wrappers

Evolution never rewrote from scratch. Brainstem and hypothalamus provide hard real-time control; limbic circuits compute value and salience; neocortex offers programmable modelling and flexible control. 

The cortex learns to predict and steer the older layers rather than replace them. This is closer to a modern software stack wrapping legacy code than to a monolithic redesign. It suggests hybrid AI architectures where slow, model-based planners manage fast, reflexive controllers through learned interfaces.

What current AI gets right—and wrong

Right: heavy use of self-supervised prediction; attention as a routing mechanism; vector-space semantics that allow composition; curriculum benefits; the power of offline training.

Wrong or incomplete: single global objectives; reliance on backprop and dense synchrony; weak embodiment; simplistic memory; limited neuromodulation; no true multi-timescale arbitration of goals.

Bridging these gaps likely requires event-driven computation, local learning rules that approximate gradient flow, richer modulatory control, and agents that learn to manage their own objectives under constraints.

Open problems that matter to engineers

How do local learning rules and dendritic nonlinearities approximate useful credit assignment at scale? How does the system infer and update its own objectives under changing internal states? What are the precise control laws for precision-weighted attention? How do replay and sleep choose what to consolidate versus erase? How is the workspace implemented physically, and what bandwidth and latency constraints define conscious processing?

The engineering takeaway

The brain is not a better transformer. It is a multi-learner control system with strong inductive biases for prediction, compression, and energy-aware action, glued together by modulators and a narrow coordination channel we experience as consciousness.

If we want AI that is more sample-efficient, more robust, and more adaptable, we should copy those principles: diversify learning rules and timescales, treat attention as precision control, make memory reconstructive and task-driven, add modulators to retune the whole agent in real time, and design for offline reorganisation.

The destination is not a brain clone, but machines that inherit the right constraints.


Thursday, October 23, 2025

The Secret of Secrets - Dan Brown

Amazon

---

I've just started reading The Secret of Secrets by Dan Brown to Clare - she normally falls asleep but luckily I record myself reading for her later replay.

I haven’t read much by Mr Brown, and I rather discounted the reviews by literary gourmets as snobbish elitism. Apparently the author writes in clichés, drops paragraphs of travelogue into the narrative and generally makes the reader wince. Surely this is just the disdain of hacks for a mega-successful writer?

Well, no.

Dear Reader, I too found myself inwardly wincing at just such tropes — the sort any diligent sub-editor should surely have flagged and burned.

The subject matter is of interest to me: the true nature of consciousness which, according to a lead character, is not generated by the brain while still apparently locating itself between the ears.

After years reflecting on the ‘hard problem’, it strikes me that we do in fact understand the neural architecture of the brain and its functional substructures quite well — it's familiar territory for any neuroanatomist. And all the operational functions of the brain map cleanly onto its anatomy.

Only consciousness, fragile as it is, refuses to modularise or fold neatly onto brain structure. It's almost as if it's not an emergent feature of brain architecture.

Perhaps we’re missing something that’s staring us in the face?


Sunday, March 10, 2019

GPT-2: what does it mean?



This got a lot of attention.
"System Prompt (human-written)

In a shocking finding, scientist discovered a herd of unicorns living in a remote, previously unexplored valley, in the Andes Mountains. Even more surprising to the researchers was the fact that the unicorns spoke perfect English.

Model Completion (machine-written, 10 tries)

The scientist named the population, after their distinctive horn, Ovid’s Unicorn. These four-horned, silver-white unicorns were previously unknown to science.

Now, after almost two centuries, the mystery of what sparked this odd phenomenon is finally solved.

Dr. Jorge Pérez, an evolutionary biologist from the University of La Paz, and several companions, were exploring the Andes Mountains when they found a small valley, with no other animals or humans. Pérez noticed that the valley had what appeared to be a natural fountain, surrounded by two peaks of rock and silver snow.

Pérez and the others then ventured further into the valley. “By the time we reached the top of one peak, the water looked blue, with some crystals on top,” said Pérez.

Pérez and his friends were astonished to see the unicorn herd. These creatures could be seen from the air without having to move too much to see them – they were so close they could touch their horns.

While examining these bizarre creatures the scientists discovered that the creatures also spoke some fairly regular English. Pérez stated, “We can see, for example, that they have a common ‘language,’ something like a dialect or dialectic.”

Dr. Pérez believes that the unicorns may have originated in Argentina, where the animals were believed to be descendants of a lost race of people who lived there before the arrival of humans in those parts of South America.

While their origins are still unclear, some believe that perhaps the creatures were created when a human and a unicorn met each other in a time before human civilization. According to Pérez, “In South America, such incidents seem to be quite common.”

However, Pérez also pointed out that it is likely that the only way of knowing for sure if unicorns are indeed the descendants of a lost alien race is through DNA. “But they seem to be able to communicate in English quite well, which I believe is a sign of evolution, or at least a change in social organization,” said the scientist."
---

Here's what Open AI, the developers of GPT-2, had to say.
"Our model, called GPT-2 (a successor to GPT), was trained simply to predict the next word in 40GB of Internet text. Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper.

GPT-2 is a large transformer-based language model with 1.5 billion parameters, trained on a dataset of 8 million web pages. GPT-2 is trained with a simple objective: predict the next word, given all of the previous words within some text. The diversity of the dataset causes this simple goal to contain naturally occurring demonstrations of many tasks across diverse domains. GPT-2 is a direct scale-up of GPT, with more than 10X the parameters and trained on more than 10X the amount of data.

GPT-2 displays a broad set of capabilities, including the ability to generate conditional synthetic text samples of unprecedented quality, where we prime the model with an input and have it generate a lengthy continuation. In addition, GPT-2 outperforms other language models trained on specific domains (like Wikipedia, news, or books) without needing to use these domain-specific training datasets. On language tasks like question answering, reading comprehension, summarization, and translation, GPT-2 begins to learn these tasks from the raw text, using no task-specific training data. While scores on these downstream tasks are far from state-of-the-art, they suggest that the tasks can benefit from unsupervised techniques, given sufficient (unlabeled) data and compute.

Samples

GPT-2 generates synthetic text samples in response to the model being primed with an arbitrary input. The model is chameleon-like — it adapts to the style and content of the conditioning text. This allows the user to generate realistic and coherent continuations about a topic of their choosing, as seen by the following select samples.

[Then there follows the 'Unicorn' text you already saw above]."
---

Scott Alexander got pretty excited about GPT-2's capabilities and wrote a series of posts arguing it was a significant step towards AGI (artificial general intelligence). This was based on his thesis that all of intelligence is predictive modelling and therefore in some sense AGI is a linear extrapolation of what GPT-2 is doing.

---

I'm not that excited about the fake news aspects. Deep-learning is tearing the ground up in the field of stochastic prediction. We're just at the foothills - to mix the metaphors. It's all quite unstoppable.

As long as we live in a human-dominated society, what you read from GPT-2 and its brethren will be what some human wants you to read. So the semantic content of the message will be parasitic on whatever the human wanted to communicate - lies or truth or bias or opinion or whatever.

So the AI is a prosthesis. Get over it.

---

I'm much more interested in the architectural questions.

The most perceptive assessments of deep-learning architectures address the critique that engineered systems adopt a tabula rasa methodology. The systems have zero prior knowledge, and merely induce parsimoniously from the offered data sets.

To which there are two good responses.

Firstly, there are many different artificial neural net topologies. For example, convolutional neural nets have a structure similar to that of the biological visual cortex and are used (amongst other things) for image processing, for example, scene and facial recognition. The pattern of local connectivity in the early processing stages of these nets implements the convolution operations which are known to be relevant to feature extraction.

Evolution didn't know that in advance. The earliest biological neural nets for vision which had been selected for ended up with this near-neighbour property genetically-coded, before they had registered even a single image. The same is true for artificial systems.

Brain anatomy does not present as a uniform pudding bowl of grey porridge. The brain has discrete modules with complicated names. Why? I guess because they do different kinds of processing and are therefore topologically optimised for different kinds of operation. We don't know yet.

In AI we have the luxury of flexibility. With a new kind of problem-domain we can experiment with all kinds of different topology, both before training and also by observing weight assignment after training. Deep-learning is going to evolve towards a brain-like situation where the data-processing invariants for all kinds of distinct tasks (such as effector-control, taste-analysis, 'emotion'-processing and consciousness-like functions) are engineered each with their optimised neural net architecture - once we discover what that is.

---

To produce text which works as an intervention in human affairs you have to be a social actor and have interests.

GPT-2 is not in any important sense an architectural precursor of such a scarily-political AI.

Wednesday, March 29, 2017

Bob Monkhouse's top three jokes

During his lifetime comedian Bob Monkhouse was widely disdained for a public persona of cheesy smarminess. Something which, as an ENTP,* he shared with Tony Blair.

In a generation dominated by working class comedic vulgarity, his middle-class intelligence and sophistication was evident. Consequently he was not popular with his peers.


Bob Monkhouse

For me what saved him was his sense of self-deprecating irony. Here are three of his best jokes which - despite familiarity - are still pretty good.

"They laughed when I said I was going to be a comedian ... They're not laughing now."

"I can still enjoy sex at 74 - I live at 75, so it's no distance."

"I want to die like my father, peacefully in his sleep, not screaming and terrified like his passengers."

(Source)

---

* ENTPs don't do (tertiary) Extraverted Feeling at all well: (Myers-Briggs personality theory).

---

If the connection between brain architecture and personality type interests you, take a look at this post. I've been reviewing recent results from the Human Connectome Project and my remarks back then seem to stand up pretty well.