Read in order ยท 9 articles
BigDocs
How to get complete, exact and repeatable results from AI on big-document work, and how to measure it. Read in order, starting with the first piece.
| Structured pipeline | One prompt, changes only | One prompt, every paragraph | |
|---|---|---|---|
| Knowing you have it all | |||
| Stopped early without saying so | 0 of 11 | Can't tell | 3 of 3 |
| Paragraphs accounted for | 100% | Not reported | 86 to 89% |
| New term no policy covers, sent to a person | 3 of 3 | No | Never reached |
| Getting it right | |||
| Planted departures classified correctly (of 15) | 14 | 10 | 10 to 12 |
| Same answer next time | |||
| Same classification in all 3 runs | 14 of 15 | Not tested | 7 of 15 |
| Agreement on how serious each one is | 96% | Not tested | 64% |
| Showing why | |||
| Decisions citing a checkable source | 85 to 87% | Not reported | 1 to 17% |
| The redline | |||
| Words deleted per changed paragraph | 6.5 | About 22 | About 10 |
| Section deleted without a marker | n/a | n/a | 3 of 3 runs |
| Effort | |||
| Cost per run | US$7 to 10 | US$0.52 | US$4 to 4.70 |
| Time per run | 5 to 6 min | 3 min | About 17 min |
- BigDocs: rolling the dice on big documents
A lot of business still runs on big documents.
- The Agentic Wordhouse: a dimensional model for your words
Most organisations keep their words the way their systems keep transactions: one document per occasion.
- Structure first: documents are written for human eyes
A contract, a tender or an enterprise agreement is written for a person turning pages.
- The instruction file: write the job down before it runs
Give an agent a big document and a library and ask it to do a thorough review.
- Never retype: if the model can't retype it, it can't mistype it
The most natural request in the world is "give me the contract back with your changes".
- Output built for oversight: put people where judgement is needed
A tidy redline is a strange thing to hand a reviewer.
- Maintaining the Wordhouse: keeping it true as it grows
Every knowledge base starts with good intentions.
- Build the tests in: borrowing confidence from engineering
Software teams stopped trusting "it looks right" a long time ago.
- BigDocs: guiding principles
The BigDocs series is about one kind of work: big documents, often several at once, where the business transaction rests on getting the answer exactly right.