The three tests that allow a second agent
Fail all three and you do not get a second agent. You get a better brief. "The writer needs a critic" fails the audit-wall test if the critic shares the writer's transcript, because it will simply confirm the writer. "Research then write" fails the capability test if the same model with the same tools does both. Most crews we have audited fail all three on every hop.
Locks instead of agents
The work people assign to extra agents is usually memory. A Continuity agent exists to remember what the last shot looked like. A Style agent exists to remember the voice. That is state, and state belongs in a file, not in a personality.
We run two documents that replace three agents:
- Consistency Lock: the immutable facts of the project. Names, palette, voice rules, forbidden words, output formats. Read at the start of every run. Never regenerated.
- Identity Lock: for anything with a recurring character or brand: the traits that may not change, the traits that may, and the drift checks. The video version is covered in Identity Lock for AI video.
A lock costs a few hundred tokens to read. An agent whose job is to remember the lock costs a full reasoning turn every time it speaks, plus the turns everyone else spends replying to it.
The gate: a QA guardian that does not chat
The one second agent we always allow is the gate, because it passes the audit-wall test. It reads the artefact and the spec. It does not read the maker's transcript. It returns a structured verdict, not a conversation.
{
"artifact": "scene_04.mp4",
"checks": [
{ "id": "identity_face", "pass": true },
{ "id": "identity_wardrobe","pass": false, "note": "jacket colour drifted to navy" },
{ "id": "continuity_light", "pass": true },
{ "id": "spec_duration", "pass": true },
{ "id": "spec_aspect", "pass": true }
],
"verdict": "REJECT",
"reject_class": "wardrobe_drift",
"retry_allowed": true
}
Sixteen checks is our ceiling. Past that the gate becomes a second author. The output is machine-readable so that the orchestrator, not another agent, decides what happens next: retry with the lock re-injected, escalate to a human, or ship.
Drift score: when to kill a run
Crews fail slowly. Each agent nudges the artefact a little, nobody owns the total, and by turn twelve you are polishing something that no longer matches the brief. Give every run a drift score: the number of gate checks that failed across the last three attempts. Two consecutive failures on the same check means the fix is in the brief or the lock, not in another retry. Kill the run, fix the document, start clean. This single rule cut our wasted generations more than any model upgrade.
Token budget per finished artefact
Budget the artefact, not the session. A finished 8-second clip, a shipped blog post, a merged pull request: each gets a token ceiling derived from what it earns or saves. If a pattern cannot deliver inside the ceiling, the pattern is wrong. Use our free AI token estimator to size briefs and locks before you run them, and the prompt cost calculator to turn a turn count into money per model. When a crew's cost per accepted artefact is six times a single agent's, the Nature MI numbers stop being academic.
Migrating a crew to an orchestrator in one afternoon
- List every agent in the current crew and the one sentence it exists for.
- Any agent whose sentence contains "remember", "keep consistent" or "make sure the style" becomes a lock file. Delete the agent.
- Any agent whose sentence is "review" or "critique" and which can see the maker's transcript becomes the gate, with the transcript removed and a JSON verdict added.
- Any agent whose sentence is a step in a sequence ("research, then outline, then draft") collapses into the main agent with the steps written into the brief.
- Whatever is left must pass one of the three tests. Usually one does, sometimes none.
- Add a token ceiling and a drift rule. Run the same task on the old crew and the new orchestrator with the same budget. Keep the winner.
We have not yet seen a solo pipeline lose that comparison.
Where skills fit
The thing that replaces most of a crew's specialists is not another agent. It is a written skill: a reusable procedure with inputs, forbidden actions and a verification step that the single agent loads when it needs it. That is the subject of Agent skills beat agent crews. If you want the locks, gate schema and skill templates as files rather than prose, the AI Agent Ops Bundle ships the spec, observability and cost-control set we run, and the Agent Prompt Vault has the brief templates. For measuring the gate in production, read the agent observability guide.
Quick answers
Did the Nature Machine Intelligence study say multi-agent systems are useless?
No. It found they help for parallelisable, read-heavy work and for narrow-domain reliability. Elsewhere they added 1.6x to 6.2x reasoning turns with no accuracy gain at matched compute.
Is a critic agent ever worth it?
Yes, when it cannot see the maker's reasoning and returns a structured verdict. A critic that shares the transcript tends to agree with the maker and costs a full turn to do so.
How do I know my single agent is strong enough?
Run the task once with a proper brief and lock and measure the gate pass rate. The paper found the single-agent baseline is the best predictor of whether coordination will help.
What replaces the memory agents?
Lock files read at the start of each run: a Consistency Lock for project facts and an Identity Lock for recurring characters or brand traits.
What is a sane token budget?
Derive it per finished artefact from what the artefact earns or saves. Size briefs with a token estimator before running and compare cost per accepted output, not cost per generation.
Fewer agents, better documents, one gate. Every product mentioned is available at wowhow.cloud — pay once, ship forever.
Comments · 0
Beta: comments are stored locally on your device and not visible to other readers.
No comments yet. Be the first to share your thoughts.