reference
Living

fan-out & spawn

The pattern where one session, running the most capable model, splits a batch into scoped pieces and spawns a worker per piece, each running a cheaper model, to execute in parallel.

A session working a batch alone pays the same rate for every step in it, the hard decisions and the mechanical ones alike. Fan-out separates the two: we let one orchestrating session keep the reasoning, while a population of workers carries out the pieces it hands off, each at a model tier suited to what that piece actually needs. Seven workers ran that way in one real batch: five features shipped in fifteen minutes, for 42% of a single Pro-plan subscription’s spend (#860).

§01 · definition

One session, many workers.

A Vinculum session runs one continuous conversation with a model, working through whatever it’s assigned one step at a time. Fan-out breaks that pattern on purpose: we split the batch into scoped pieces first, and spawn a worker for each piece, all running at the same time instead of one after another.

The orchestrating session (Vinculum calls it the colonel) keeps the reasoning: what the batch needs, how to divide it, what to do with each result as it comes back. Each worker, a grunt, gets exactly one piece: a directive, a boundary on what it can touch, and a model tier picked for that job specifically. The colonel plans and supervises; the grunt executes its slice and nothing past it.

§02 · two costs, not one

The expensive model plans. The cheap one executes.

Running a long batch through one continuous conversation charges the same rate for every step in it: the hard decisions and the mechanical ones both billed at whatever tier that one session runs on. Fan-out splits that rate in two. We run the colonel on the most capable tier, because deciding what to build and how to divide it needs that capability. A grunt runs on a cheaper, faster tier by default, because carrying out one already-scoped piece of work doesn’t.

That split holds regardless of how many workers are running. The colonel’s own reasoning cost stays close to flat whether it’s watching one worker or seven, because the job is still deciding once and reading results as they come in. What scales with headcount is the workers’ execution cost, priced at the cheap tier throughout.

§03 · running at once, not in line

Work finishes on its own schedule.

A single session working a batch one task at a time pays for every task in series: task two waits on task one, task three waits on task two, and the wait gets billed the same as the work. Workers spawned in parallel skip that queue. Each one runs against its own slice from the moment it’s spawned and finishes when that slice is done, regardless of what’s happening in any other worker.

The colonel doesn’t wait on any single worker to keep working either. It checks results as they land, spawning more workers or closing out finished ones. A batch’s wall-clock time ends up tracking whichever piece takes longest to finish, however many other pieces already have.

§04 · the receipt

Seven workers, one batch, tracked as it happened.

One real batch shows the shape rather than argues for it. Seven workers ran at once against a single directive: five features shipped in fifteen minutes, including a full-stack change spanning 13 files and 35 tests, while two more workers kept running and a third piece of work sat queued behind them. Running the whole batch — the colonel’s oversight and every worker’s execution together — cost 42% of a single Pro-plan subscription’s spend (#860).

The colonel’s own cost barely moved between watching one worker and watching seven: one session, deciding once, then reading results as they land. Every worker’s execution cost scaled with headcount instead, but held to the cheapest model tier available. Cost in this batch tracked the amount of work, whatever the headcount running it.

What was measuredThe number
workers in the batchSeven, running in parallel against one directive.
features shippedFive, in fifteen minutes, one of them a full-stack change spanning 13 files and 35 tests.
spend42% of a single Pro-plan subscription.
still in flight when measuredTwo workers running, one more piece of work queued.
sourceVinculum substrate entry #860.
§05 · common questions

Common questions.

Does spawning more workers cost more overall?

It tracks the amount of work in the batch. In the one batch this page cites, the colonel’s own cost stayed close to flat whether it was overseeing one worker or seven, and each worker ran the cheapest model tier by default (#860).

What decides which model tier a worker runs on?

The complexity of the slice it’s assigned. Mechanical, well-specified work runs the cheapest tier by default; a slice that needs judgment the spec didn’t already resolve gets a step up. The colonel always runs the most capable tier, because deciding how to split the batch is the one job that isn’t delegated. Roles & the officer tier covers how those assignments are enforced.

What stops two workers from touching the same work?

A claim. Each worker’s directive states which files or areas it’s allowed to touch, declared at the moment the work is claimed, and two workers can’t claim the same piece. Directives & claims covers what a claim actually locks and what happens when a worker stalls mid-task.

see also

Related entries.

architecturefan-out & spawn