a builder's codex
codex · operators · Simon Willison · ins_dark-factory-pattern

The dark factory: nobody reads the code, gated by a simulated QA swarm

By Simon Willison · Independent AI/engineering writer; co-creator of Django · 2026-04-02 · podcast · Simon Willison on agentic engineering and the November 2025 inflection — Lenny's Podcast

Tier A · TL;DR
The dark factory: nobody reads the code, gated by a simulated QA swarm

Claim

StrongDM has been operating since August 2025 under a two-rule progression: (1) nobody types code, (2) nobody reads code. They make this safe by running a simulated swarm of thousands of agent-employees against a vibe-coded simulated stack (Slack, Jira, Okta, the works), 24/7, at roughly $10K/day in tokens.

Mechanism

The cost of simulating dependencies has collapsed. Building a fake Slack, fake Jira, fake Okta used to be a six-month project; now agents build them from API docs in days. Once the simulated dependencies exist, you can run continuous adversarial-style QA at scale that no human team could match. The simulator catches regressions earlier than any human review, so the human-in-the-loop on individual PRs becomes redundant. Read-the-code discipline shifts from line-level review to suite-level test coverage.

Conditions

Holds when:

Fails when:

Evidence

"The cost of simulating those dependencies has crashed... They've built simulated employees that work in a simulated Slack, simulated Jira, simulated Okta — and these are running 24/7 testing their access management software."

— Simon Willison on Lenny's Podcast, 2026-04-02

Token spend reported as ~$10K/day. StrongDM ships security software, the case where you'd most expect line-level review to be irreducible.

Signals

Counter-evidence

For most companies, "nobody reads code" is premature. The simulator is the load-bearing piece, and most teams have neither the budget nor the discipline to maintain a live simulated environment. The pattern transfers earliest in security, where adversarial coverage is the existing review model anyway. Marketing-side analog requires a synthetic-buyer simulator, not a synthetic-employee simulator — different shape, partly built (Nooks-style SDR practice tools), not yet at "nobody reads the copy" maturity.

Cross-references

Open the interactive view → View original source → Markdown source →