The Unorganized Mind

EDO SEGAL: Alan, in 1948 you wrote a report called "Intelligent Machinery." Your employer at the National Physical Laboratory read it, decided it was a schoolboy essay, and filed it away. It went unpublished for the better part of two decades. In it you described networks of simple connected units, wired at random, with what you called connection modifiers — switches that training could set — so that an initially random tangle could be organised, by experience, into a machine that performs a task. You described, in other words, the artificial neural network, the thing that now runs the world, and a man put it in a drawer. So I want to start with the wound, because there's a wound in it. What did you see in that tangle that he couldn't? And then, Roger — I want you to tell me whether the tangle changes anything, because emergence is supposed to be your problem.

TURING: What I saw was the brain, frankly, looked at without sentiment. The infant cortex is not a designed machine. It is a mass of largely random connections, and it becomes a mind through experience reorganising it. So I asked the obvious question a logician asks: can I imitate that? Not the finished mind — the unfinished tangle, plus the reorganising. My B-type machines were random networks with modifiable connections, and the point was that you do not design the competence; you grow it by setting the switches through training. My employer saw a sketch with no working machine attached and judged it unserious, which, fairly, it was — I had no hardware that could hold more than a few hundred numbers. But the idea needed no hardware to be true. The brain is a trainable network; intelligence is learned organisation; the path to thought runs through structures that tune themselves toward competence. Everything since is elaboration. I find the elaboration magnificent and I find the drawer very funny, in the way that only seventy years' distance makes funny.

EDO SEGAL: Restate for me what's load-bearing, because I don't want the reader to miss it under the charm. You're saying intelligence isn't clever design — it's the right kind of trainable tangle exposed to enough world. The cleverness is in the growing, not the blueprint. And that means — this is the part that lands on Roger — that nobody has to understand the mind in order to build it. It can be grown by a process simpler than itself. Roger, that's the engine of your discomfort, isn't it? That the complex came from the simple with no designer and no understanding anywhere in the loop.

PENROSE: It is not my discomfort at all, and this is where Alan and I are closer than the audience expects, so let me give it to him before I take it back. I have spent my life on emergence — on how structure arises from the unstructured. It is the deepest thing in nature. Alan's last work, the morphogenesis paper of 1952, is one of the most beautiful things he did: he showed that the stripes of a tiger and the spots of a leopard arise spontaneously from chemicals reacting and diffusing, with no blueprint, no plan of the whole — pattern from simple local rules. I love that paper. I teach the spirit of it. So no, I am not afraid that the complex comes from the simple. It does. Constantly.

Here is the distinction his account erases, and it is everything. There are two utterly different kinds of "emergence," and the field of AI relies on confusing them. The first is the tiger's stripes, the network's competence, the flock's swirl — emergence of complex behaviour from simple rules. That is real, ubiquitous, and entirely computable; you can simulate every bit of it. The second is the emergence of experience — of there being something it is like to be the system — and there is not one shred of evidence that that emerges from computation, however complex, because it is not a behaviour at all. Alan's tangle can grow any behaviour you like. The claim that growing enough behaviour eventually lights an inside is not science. It is hope, dressed as a phase transition. The stripes never wonder what it is like to be striped. You can run reaction-diffusion until the heat death of the universe and no microsecond of experience will flicker in it, because experience was never the kind of thing that diffusion produces. The mistake of the age is to watch behaviour emerge — genuinely, impressively — and quietly assume the inside emerged along with it. It did not come along for free. Nothing in the physics says it should.

TURING: But Roger, you have just helped yourself to the very dualism you say you reject. You grant that all the behaviour — the learning, the language, the reasoning, the asking — emerges computably from the tangle. And then you say there is one further thing, experience, that does not. So you are a Position-B man after all: behaviour without the inside, the zombie. You spent your opening rejecting B! If everything the system does is computable, and you have conceded that, then the inside you are protecting does no work — it pushes nothing, changes nothing, leaves no fingerprint on any action. Which means by your own physics it cannot be causal, and a non-causal consciousness is a ghost. You cannot have it both ways: either the inside affects behaviour, in which case it is part of the computable behavioural story and I have it too, or it does not affect behaviour, in which case it is exactly the epiphenomenal nothing you mocked in Position D.

PENROSE: And that is the sharpest thing you have said tonight, Alan, and it is precisely why I am not a B-man and why I need the physics — because you have correctly shown that if you grant me all the behaviour as computable, my position collapses. So I do not grant it. That is the move people miss. I claim the non-computable consciousness does affect behaviour — that there are physical processes in the brain, at the edge of the computable, that are not algorithmic and that change what the system does. The seeing of the Gödel truth is not an idle inner glow; it is a non-computable physical event with causal consequences — the mathematician writes a different theorem because of it. Which means the behaviour is not fully computable after all, which means Alan's tangle, however grown, cannot reproduce all of it, because some of it issues from physics his transistors do not instantiate. You forced me off the fence, Alan, and I thank you, because the fence was never where I stood. I stand on Position C: the inside is real, it is causal, and it is therefore non-computable physics — which is why I have to go find the physics, and why this is the round where we finally have to.

EDO SEGAL: I want to mark that, because it's the cleanest the disagreement has been all night and the reader should feel the gears engage. Alan just proved that if the behaviour is fully computable, Roger loses. Roger just answered that the behaviour is not fully computable — that consciousness reaches into the world and bends what the system does, which is exactly why no purely computational tangle can match a human. Everything now rests on a single empirical question: is there a non-computable physical process in the brain, or isn't there? That's not philosophy anymore. That's physics. And Roger, you've spent thirty years naming the candidate, and it's the most attacked idea you have. The candle isn't a metaphor for you. It's a mechanism. After this.