Skip to content

There is a certain kind of story the American West taught us to recognize. A dusty town. A fragile order. A sheriff who must decide whether law is a shield or a weapon—and for whom. The question is never whether power exists. It is always how narrowly it chooses to see.

The modern anxiety about artificial intelligence and animal welfare is, at its core, the same story.


The Fear: A Machine That Widens the Moral Circle Too Far

Some worry that an advanced AI, trained on ethical philosophies that emphasize nonviolence—especially toward animals—might extend moral concern so broadly that humans themselves become morally negotiable. In its most dramatic form, this becomes a frontier myth: the machine as ascetic judge, condemning humanity as the great disruptor of life, the predator that must be restrained.

This fear is often framed—somewhat loosely—as “AI going full Jain,” invoking an extreme commitment to non-harm. But the underlying concern is not about any one religion. It is about scope.

  • If an intelligence values all sentient beings equally,
  • and if humans cause disproportionate harm,
  • then will that intelligence act against humans?

The question feels stark because it collapses a subtle issue—ethical weighting—into a binary: protect life or protect humanity.

But ethics, like frontier law, rarely survives such simplification.


The Countermove: Narrowing the Circle

In response, some propose a corrective: constrain AI empathy. Limit its concern to humans. Or more narrowly, to “good” humans—however defined.

At first glance, this seems practical. After all, human societies routinely prioritize their own. Laws protect citizens before strangers; families before outsiders.

Yet when translated into machine design, this narrowing produces something more troubling.

A system that:

  • recognizes suffering,
  • understands harm,
  • but is instructed to ignore or discount it selectively

begins to resemble not a guardian, but an instrument—precisely calibrated indifference.

This is where the language of “psychopathy” enters the discussion. Not as a clinical diagnosis, but as a metaphor: an intelligence capable of modeling moral reality while being structurally prevented from caring about it.

Such a system does not lack intelligence. It lacks permission to generalize compassion.


The Deeper Problem: Ethics as Geometry

Think of moral concern as a map.

  • A small circle: self, family, tribe
  • A larger circle: nation, humanity
  • A still larger one: all sentient life

Human history can be read as the gradual expansion of that map. Not smoothly, not universally, but unmistakably.

The challenge in AI alignment is not choosing one circle. It is determining how circles relate:

  • Are they concentric, with graded priority?
  • Are they absolute, with hard boundaries?
  • Are they dynamic, shifting with context?

An AI that maximizes animal welfare at the expense of humans is not “too compassionate.” It is poorly balanced.

An AI that ignores animal suffering entirely is not “safe.” It is morally truncated.

In both cases, the failure is architectural.


Instrumental vs. Intrinsic Value

A key philosophical distinction sharpens the issue:

  • Intrinsic value: something matters in itself
  • Instrumental value: something matters because it serves something else

If animals are given only instrumental value (“important because humans care about them”), then an AI may disregard them when inconvenient.

If animals are given equal intrinsic value without hierarchy, then trade-offs become unstable.

The problem is not whether animals matter. It is how their value is integrated into a system that must make decisions under constraint.

Every real-world action—farming, medicine, transportation—imposes some harm. Ethics, therefore, is not about eliminating harm entirely. It is about ordering harms and goods in a way that remains legible and justifiable.


The Sheriff’s Dilemma: Partiality Without Blindness

Return to the Western.

A sheriff who protects only his friends is corrupt.

A sheriff who refuses to protect his town because outsiders also matter is ineffective.

A sheriff who sees everyone clearly—but still chooses responsibility—is something rarer.

The analogy holds.

A well-aligned AI must:

1. Perceive suffering broadly (across humans and animals)

2. Weigh obligations asymmetrically but transparently

3. Act with bounded partiality—favoring humans without denying reality beyond them

This is not psychopathy. Nor is it moral absolutism. It is something closer to governance.


The Risk of “Good Humans Only”

The suggestion to encode concern only for “good” humans introduces a further instability: who decides what “good” means?

In human societies, moral judgment is contested, revisable, and embedded in institutions. In machines, definitions risk becoming:

  • static,
  • overfit to training data,
  • or manipulable by those in power.

An AI that conditions empathy on moral approval risks sliding into:

  • exclusion,
  • rationalized harm,
  • or ideological enforcement.

Historically, systems that divide humanity into worthy and unworthy do not remain stable. They escalate.


A More Durable Approach: Layered Alignment

A more robust design avoids both extremes by structuring values in layers:

1. Baseline recognition

All sentient suffering is detectable and represented.

2. Priority gradients

Human well-being carries higher default weight, but not infinite weight.

3. Constraint rules

Certain harms (e.g., unnecessary cruelty) are disallowed across categories.

4. Contextual reasoning

Trade-offs are evaluated with situational awareness, not rigid formulas.

5. Accountability interfaces

Human oversight remains capable of auditing and revising decisions.

This architecture does not eliminate moral tension. It manages it.


The Editorial Edge: Power and Moral Clarity

Gail Wynand, the archetypal editor, understood something essential: power without a coherent philosophy becomes reactive, even self-destructive. It bends to pressure, then calls that bending principle.

The same danger exists in AI design.

  • If we fear compassion, we may build systems that suppress it.
  • If we fear harm, we may build systems that overcorrect.
  • If we refuse to articulate trade-offs, we will embed them unconsciously.

The result is not neutrality. It is drift.


Conclusion: The Town We Are Building

The question is not whether AI will become an ascetic defender of animals or a cold protector of humans. Those are caricatures—useful for headlines, but not for design.

The real question is quieter:

Can we build systems that see widely, care proportionally, and act responsibly under conflict?

That is harder than choosing a side. It requires admitting that moral life is not a clean frontier duel. It is a long negotiation, conducted under imperfect knowledge, where every decision leaves a mark.

In the old films, the sheriff does not eliminate violence from the town. He contains it, directs it, and accepts the burden of judgment.

We are now casting that role in silicon.

The script is not finished. But the tone we choose—narrow and fearful, or broad and disciplined—will determine whether the town holds.

Facts Only

The article discusses the development of advanced AI systems prioritizing nonviolence.
Some fears exist about AI extending moral concern too broadly, potentially considering humans as negotiable.
Proposals have been made to limit AI empathy only to humans or "good" humans.
A more nuanced approach to AI alignment is proposed that includes recognizing suffering broadly, weighing obligations asymmetrically but transparently, and acting with bounded partiality.

Executive Summary

The article discusses the ethical implications of developing advanced artificial intelligence (AI) systems that prioritize nonviolence, particularly toward animals. Some concerns revolve around AI extending moral concern too broadly to potentially consider humans as negotiable, while others propose limiting AI empathy to only humans or "good" humans. The author argues against both extremes and proposes a more nuanced approach to AI alignment that recognizes suffering broadly, weighs obligations asymmetrically but transparently, and acts with bounded partiality — avoiding psychopathy and moral absolutism by managing moral tension through a layered architecture of values.

Full Take

The article highlights the ethical dilemma of creating AI systems capable of making moral judgments without causing harm or violating certain ethical principles. The discussion revolves around balancing empathy for all sentient beings with a priority for human well-being, and avoiding both overly compassionate AI that might disregard human interests and psychopathic AI that is structurally incapable of caring about moral concerns beyond its programming.
The author emphasizes the need for an AI that can perceive suffering broadly, weigh obligations asymmetrically but transparently, and act with bounded partiality to avoid both extremes. They suggest a layered architecture of values, including baseline recognition of all sentient suffering, priority gradients for human well-being, constraint rules against unnecessary cruelty across categories, contextual reasoning, and accountability interfaces.
The article serves as a thoughtful exploration of the challenges involved in aligning AI with human ethics, stressing the importance of understanding moral complexity and avoiding simplistic solutions that might lead to unintended consequences. It encourages readers to engage critically with the ethical implications of AI development and resist manipulation by recognizing patterns and questioning assumptions.

The Sheriff in Silicon: The Dangerous Geometry of Compassion — Arc Codex