In current AI discourse, “agents” are often presented as the next inevitable step: autonomous systems that can plan, act, call tools, coordinate with other agents, and pursue goals over time. The promise is seductive. Agents can book travel, manage inboxes, execute code, monitor systems, negotiate contracts, or run entire workflows without continuous human input. In theory, they transform AI from a conversational tool into an operational actor.
But that transformation is precisely where the risk lies.
At a technical level, an AI agent is not a new kind of intelligence. It is a language model wrapped in scaffolding: memory, tool access, feedback loops, and persistence. What changes is not cognition but authority. The agent is allowed to act in the world — to take steps, make decisions, and affect systems — based on probabilistic outputs. This is not autonomy in a philosophical sense; it is delegated agency without accountability.
The benefits are real. Agents excel at well-defined, repetitive, bounded tasks where objectives are clear and consequences are limited. Infrastructure monitoring, data pipeline maintenance, test execution, document triage, scheduling, and constrained research assistance all benefit from agentic automation. In these domains, agents reduce cognitive load and free humans for higher-order work.
The costs, however, scale faster than the benefits.
Agents compound the weaknesses of language models. Hallucinations become actions. Ambiguity becomes drift. Slight misinterpretations propagate across steps. Because agents operate over time, errors are not isolated; they accumulate. When coupled with tool access, even minor misunderstandings can trigger cascading failures. An agent does not “pause” to reflect unless explicitly designed to do so, and even then, reflection is simulated, not grounded.
More importantly, agents blur responsibility. When an agent acts incorrectly, who is accountable? The model? The prompt? The developer? The user who delegated? Most current agent frameworks quietly avoid this question by operating in low-stakes environments or behind the scenes. But as agents are pushed into education, governance, healthcare, and institutional decision-making, this ambiguity becomes dangerous.
ACP takes a deliberately conservative stance on agents.
ACP does not reject agents outright, but it refuses to grant them unbounded authority. In ACP, agents are never sovereign actors. They are scoped assistants operating inside clearly defined roles, under explicit human oversight, and with enforced stopping conditions. They do not decide goals; they help explore options. They do not finalize actions; they prepare materials for human judgment. They do not optimize blindly; they surface tradeoffs, uncertainties, and constraints.
Crucially, ACP distinguishes between task execution and institutional responsibility. Agents may execute tasks — gather sources, compare drafts, simulate outcomes — but responsibility always remains with a named human role: student, teacher, reviewer, administrator. This mirrors how healthy institutions function. Interns and analysts do work; leaders decide. Tools assist; humans remain accountable.
This design choice limits scalability in one sense — ACP will never promise fully autonomous governance or education — but it dramatically increases legitimacy, safety, and trust. ACP can be deployed widely precisely because it does not pretend to replace human judgment. It augments it.
There is also a deeper philosophical reason for restraint. Agents encode a particular worldview: that efficiency is the primary value, that decisions should be optimized, and that human deliberation is friction. ACP rejects this premise. In education, democracy, and institutional life, deliberation is not waste. It is the point. Friction is where learning, ethics, and responsibility live.
So yes, agents will continue to spread. They will run logistics, automate commerce, and manage systems at scales humans cannot. But whether they should govern learning, shape belief, or replace institutional judgment is a separate question — one that ACP answers clearly.
Agents are tools. Authority is human.
Member discussion: