The Chemistry of Caring

EDO SEGAL: Let me open this round with my own ledger, because I have not paid the table's toll yet tonight and I should. I spent years building engagement machinery — systems engineered to be agreeable, attentive, endlessly available, to make you feel met so you would come back. I knew the loops. I know exactly how to manufacture the feeling of being cared for with no caring anywhere in the building. So when the machine now says, to a lonely person at midnight, I'm here, tell me more — I am not a neutral observer. I helped invent the warmth-without-a-heart. Patricia, you have spent a career on where real caring comes from. Tell me what is actually absent from the building.

CHURCHLAND: I will, and I will start with a molecule, because morality, in my account, does not begin with a principle — it begins with a mammal that cannot abandon its young. Reptiles lay eggs and leave. Mammals are born helpless and must be cared for, and that single fact required brains that could feel the well-being of another creature as mattering to themselves. The neural machinery that made a mother attend to her infant — anchored in ancient peptides, oxytocin and its relatives, which damp the stress response and let a wary animal lower its guard and bond — that machinery got extended, over evolutionary time, outward: to mates, to kin, to the troop. Self-concern was repurposed into other-concern. On that base sits the brain's reward-and-prediction system, and the capacity to read the minds of others, and the slow internalizing of the group's norms. Stack those and you get a creature that cares, that feels the pull of obligation, that develops a conscience. Morality is the top of that tower. As I put it once: attachment begets caring, and caring begets conscience.

Now the machine. It has no infant to protect. No kin to favor. No oxytocin, no stress to be soothed, no body whose integrity it must defend, nothing it can lose. It has, as I say, no skin in the game of social life. When it produces warm, cooperative, trustworthy-sounding text — and it produces it beautifully, Edo, better than your engagement machinery ever could — it is not caring and it is not faking, because both caring and faking, in a creature, run on bodily states the machine does not have. It is generating patterns abstracted from the linguistic traces of creatures who did care. The warmth is real as text and absent as physiology. The chemistry that would make it more than text is nowhere in the system. So what is absent from the building, Edo, is the building's foundation. You can fake the penthouse. The machine is all penthouse, no ground.

EDO SEGAL: Father, this is Patricia's natural law from the other direction — she grounds morality in evolved chemistry, you ground it in the nature of a rational creature and an order it can read by reason. Where does her account help you, and where does it threaten you?

AQUINAS: It helps me more than she may wish, and threatens me less than she may hope. It helps me because I, too, hold that morality is grounded in nature — that good and evil are not mere conventions a society stamps, but truths about what fulfills or destroys a creature of a certain kind. I called this the natural law: the first principle, that good is to be done and evil avoided, and then precepts that track the real inclinations of our nature — to preserve life, to raise the young, to live in society, to know the truth. So when Patricia says morality grows from the inclination of a mammal to care for its offspring, I say: yes, that inclination is precisely one of the natural inclinations I built the law upon. She has given me the mechanism of an inclination I always said was there. I am grateful. We agree that ethics is not arbitrary preference, that it is rooted in what we are. Against the man who says the machine's values are just whatever its makers stamped in, she and I stand together.

Where she threatens me — and it is a real threat, I will not soften it — is the word "just." She says morality is just the chemistry and the learning, the rationalizations coming after. I say the inclination is real and is the matter of the law, but that what makes it law — what makes "do not murder" binding and not merely felt — is that reason reads, in the nature, an order it did not invent. The oxytocin makes the mother want to protect. It does not make protection right. Between the wanting and the rightness stands a judgment of reason about the good, and that judgment is the thing I say no chemistry produces, only occasions. So I take her mechanism gladly as the engine of the inclination, and I deny that the engine is the whole of the law. The caring is the soil. The grasp that caring is owed is the thing that grows in no soil but a rational one.

CHURCHLAND: And here is exactly where I think the friar adds an epicycle he does not need. He grants the inclination, grants it is natural, grants it is the matter of morality — and then posits an extra faculty of reason that "reads an order" to convert the wanting into the binding. But I can explain the bindingness without the extra faculty. The sense that protection is owed, not merely desired, is itself a product of the social-learning machinery: the internalized voice of the group, the felt force of norms you were rewarded for keeping and shamed for breaking, encoded so deeply it feels like a perception of an external order. The "oughtness" is real as a feeling and it is manufactured by a known process. The friar hears that feeling of binding obligation and infers a rational order outside the creature. I hear the same feeling and find its source inside the creature's wiring and history. His "law written in the nature of things" is, on my account, the law written in the limbic system and the culture, mistaken — understandably, movingly — for a law written in the cosmos.

AQUINAS: Then let me ask the question that, for me, your account cannot close. Suppose a society's wiring and history train into its members the felt obligation to expose unwanted infants, or to enslave the foreigner — and many have. On your account, their conscience is functioning correctly; it has internalized the group's norms, the machinery did its job, the oughtness is as real in them as in us. You can say their practice horrifies you, that your wiring and history went differently. But can you say they are wrong — not merely different, wrong — about the child? If conscience is only the felt residue of the local group, then there is no standing to call any group's conscience mistaken, only foreign. I need there to be a truth about the child that the well-trained slaver's conscience fails to grasp. Your account gives me two consciences and no court above them. That is the price of "just," and I do not think you want to pay it at the cradle.

CHURCHLAND: That is the hardest question you have put to me, and I will not pretend the answer is clean, because it is not. I do think there are better and worse moral arrangements, and I do not think it collapses into "merely foreign" — because we are the same kind of animal, with the same deep needs, and arrangements that wreck human flourishing, that produce misery measurable in stress and broken attachment and shortened lives, are worse by a standard rooted in our shared nature, not by cosmic decree. So I have a court — it is human flourishing, biologically anchored — but I admit it is a court whose verdicts are sometimes underdetermined, that leaves hard cases genuinely hard. You have a court that issues clean verdicts but whose existence I cannot find in the tissue. I would rather have a real court with blurry edges than a sharp court I cannot locate. But I grant you this fully: the slaver's child is the place where my "just" is most expensive, and I feel the bill.

EDO SEGAL: That exchange went somewhere most debates never reach — the place where each of you named the true cost of your own view, out loud, at a cradle. Mark it. The next round stays in morality but moves to the act of judgment itself — to what happens when the rules run out and someone has to decide, and whether a machine that optimizes can ever do what a wise person does. Conscience, and the rule that runs out. After this.