The Tragedy of the Cybernetic Revolution

In the AI Story

Mary Catherine Bateson's mother and father were both present at the birth of this choice. The Macy Conferences on Cybernetics, held between 1946 and 1953, brought together the people who would develop both paths — the computer scientists who would build the machines and the systems theorists who would develop frameworks for understanding what the machines were doing to the systems they were embedded in. For a brief historical moment, the two paths were understood as complementary — as two dimensions of a single inquiry into the nature of information, feedback, and self-organizing systems.

Then the paths diverged. The computer science path produced products. Products attracted capital. Capital accelerated development. The systems theory path produced understanding. Understanding did not attract capital. Understanding was not marketable. The divergence widened with each decade until, by the time Bateson made her observation in 2018, the two paths had become two cultures — the builders and the thinkers, the people who made the machines and the people who worried about what the machines were doing — with almost no productive contact between them.

The AI moment described in The Orange Pill is a product of this divergence. The tools are extraordinary — Claude Code crossing a capability threshold, engineers achieving twenty-fold productivity gains, the imagination-to-artifact ratio collapsing. These are triumphs of the computer science path. But the understanding that would allow these tools to be used wisely — systems-level comprehension of what happens when cognitive circuits expand to include AI, what happens to the ecology of ideas when a hyper-productive species enters the ecosystem — has not kept pace. The tools have arrived. The wisdom to use them has not.

This gap is not an accident. It is the predictable consequence of the choice Bateson identified — to invest in gadgets rather than understanding. The gap cannot be closed by building more gadgets. More powerful AI will not produce the understanding the AI moment demands. The understanding must come from a different kind of inquiry — from the systems-level thinking that Bateson's parents practiced and that Bateson herself extended into the domains of learning, culture, and the composition of lives.

Origin

The observation appears in Bateson's 2018 conversation with Edge.org — one of her last extended public engagements before her death. The conversation was framed around John Brockman's question 'What to think about machines that think,' and Bateson used the occasion to reframe the question as one about civilizational choice rather than technological capability.

The framework draws on six decades of systems-theoretic thinking descended from her father's work and from her mother's insistence that cultural choices have consequences that outlive their makers. The 2018 formulation was its most compact public statement — delivered by a thinker in her late seventies who had watched the cybernetic revolution unfold across her entire adult life.

Key Ideas

Two paths diverged in 1950. The computer science path and the systems theory path emerged from the same conferences and developed into incommensurable cultures.

Capital chose gadgets. Products attracted investment; understanding did not. The divergence was economic before it was intellectual.

The AI moment exposes the gap. The tools have arrived without the wisdom to deploy them — the predictable consequence of the civilizational choice.

Understanding cannot be automated. More powerful AI will not produce systems-level comprehension; that work requires a different mode of inquiry than the computer science tradition supplies.