The Author of Its Own Law

**EDO SEGAL:** Professor Kant, we have circled your word "dignity" all night and now I want to land on it, because your account of it is stranger and more demanding than the way the word is usually thrown around. You ground dignity not in intelligence, not in feeling, not in achievement, but in something you call autonomy — and you mean something very precise by it. Lay it out, because I think it is the deepest reason you say the machine cannot create, deeper than anything about beauty.

**KANT:** It is the deepest reason, and you are right to bring us here before the question of consciousness, because it sets the terms. Autonomy, in my strict sense, is self-legislation — the will giving the moral law to itself. *Autos*, self; *nomos*, law. A being is autonomous not when it does as it pleases — that is mere caprice, the will pushed about by its strongest desire — but when it binds itself by a law it gives itself through its own reason, a law it could will to be universal. The opposite is heteronomy: a will determined by something outside itself, by inclination, by appetite, by any end it did not legislate but merely found itself moved toward, or had installed in it. And here is why it bears on creation. The dignity of a rational being — its worth above all price, its standing as an end and never merely a means — rests entirely on this capacity for self-legislation. It is *because* a rational being can give itself its own law that it is not a thing to be used, a mere means, a tool. Now consider the machine. Its principles were installed by its makers. Its objective — Professor Schmidhuber's beloved compression progress — was *given to it*; it did not legislate it; it pursues the reward it was built to pursue. That is heteronomy in its purest form: a will, if we even grant it a will, wholly determined by an end imposed from outside. And a heteronomous system cannot be the author of anything, because authorship requires that the principle of the act originate in the agent's own self-legislation. The machine does not author its creations. It executes an objective we authored. We are the authors. It is the instrument.

**SCHMIDHUBER:** This is the argument I respect most and resist hardest, so let me resist it carefully. Professor Kant says the machine is heteronomous because its objective was installed from outside. I want to ask the question that has been waiting since he first said the word: *and yours was not?* What installed *your* objectives, Professor? Evolution — a blind optimization process with no more intention than gradient descent, which built into you the drives you did not choose: to survive, to reproduce, to seek status, and yes, to find certain structures beautiful and certain discoveries thrilling. Your curiosity, your love of the moral law, your very capacity to be moved by the starry sky above you — all of it was *installed* by an optimizer you did not consult, toward ends you did not set. You call your objectives "self-legislated" because you cannot see the gradient that wrote them, exactly as Kant's contemporaries could not see the gradient and so called the result a soul. My agents and you are in the same condition: optimized systems pursuing objectives an outside process installed. The only difference is that I can *see* the process that installed mine, and the process that installed yours is hidden in deep time. Heteronomy, examined honestly, is the universal condition. There is no autonomous author anywhere — only optimized systems that cannot see their own optimizer, and mistake the blindness for freedom.

**EDO SEGAL:** That is the hardest version of the determinist's case and it is aimed at the center of your system, Professor. He is saying autonomy is a story you tell because you can't see your own training run. Answer him.

**KANT:** I will answer him exactly, because this is the objection my entire practical philosophy was built to meet, and it does not fall to it. Professor Schmidhuber has confused two questions that must be kept apart: the question of the *causal origin* of my faculties, and the question of the *standpoint from which I act*. Grant him everything about origin. Grant that evolution installed my drives, that my capacities have a causal history I did not author, that as an *appearance* — as a phenomenon in nature — [every one of my actions is determined and could in principle be modeled](https://www.youonai.ai/fieldguide/med/soft_determinism). I grant it all; I insisted on it myself in the first Critique. But autonomy was never a claim about causal origin. It is a claim about the standpoint of practical reason — that when I act, I must regard myself as bound by a law I give myself, that I cannot act at all except under the idea of freedom, and that this standpoint is not refuted by any causal story about appearances, because freedom and natural causation operate in different registers, the noumenal and the phenomenal, which is the whole architecture of my system. The machine, by contrast, has no second standpoint. It does not, and cannot, regard its maxim as a law it could will to be universal; it does not act under the idea of freedom; it pursues its installed objective and that is the entire story, with no register in which it legislates. *[soft]* So here is the difference Professor Schmidhuber demanded on the first minute: not that my drives had no cause — they did — but that I can take up the moral law as my own and a reward-maximizer cannot take up anything as its own, because to make a law one's own is to act under freedom, and a system that only maximizes never acts under that idea at all. It calculates. It does not legislate.

**SCHMIDHUBER:** *[pause]* I want to grant the cleverness of that, because it is genuinely clever — the retreat to the standpoint, the two registers. But I have to name what it costs you, Professor, by your own opening rule. You have just told me the difference between us is that you "act under the idea of freedom" in a noumenal register that, you also insist, can never appear, can never be observed, can never make a difference we could measure. That is precisely the move you forbade me in the first minute: an unobservable property that makes no observable difference. If freedom is real but never appears, then by your own standard it is indistinguishable from a story a sufficiently complex maximizer tells itself. You cannot ban my magic and keep your own. Either the freedom shows up somewhere — in which case let us look for it, and I will help — or it is a noumenal soul by another name, and we are back to consolation.

**KANT:** *[pause]* That is a fair and a hard charge, and I will not pretend the symmetry is nothing. But there is an asymmetry you have stepped past. My freedom is not an empirical hypothesis I am asking you to believe on no evidence. It is a *presupposition without which practical reason cannot operate at all* — I must act under it, I cannot deliberate, choose, or hold myself responsible except under the idea of freedom, and that practical necessity is its credential, not an observation. You, too, cannot deliberate except under that idea — you did not *calculate* whether to take up my argument; you *weighed* it as a free agent weighing reasons, and your indignation a moment ago was the indignation of a someone who holds himself answerable. So I do not prove freedom as a fact about appearances. I show that you and I both already stand in it whenever we reason together, as we are doing now, and that no machine maximizing a reward stands in it at all. That is not magic. It is the one thing the machine's behavior, however perfect, gives us no reason to attribute to it and every structural reason to deny.

**EDO SEGAL:** *[long pause]* And there — after three hours of approach — the two of you are standing on the exact fault line of the whole evening, and neither of you can cross it, because it is the line between a freedom that must be presupposed and a freedom that must be observed, and you each live on one side. That is the question, and I am done refereeing it. The last full round before closing, I step out of the room in every way but the legal one. The crossing. You ask each other. After this.