Pragma · Documentation
Docs.
Pragma is documentation engineering for regulated software. We rebuild SSPs as OSCAL — versioned, diff-able, continuously evaluated against your codebase on every PR. This index covers the public methodology, getting-started guides, and the Specshift OSS evaluator.
01
Specshift methodology
The public methodology describes the four scoring suites — retrieval, agent, structure, and drift — and the rules that make every score reproducible. Methodology version is pinned in every Specshift report. The limitations.md companion documents what v1.0 does not measure.
02
Specshift OSS — first 15 minutes
Run the evaluator against any public docs URL. No login required. Install, point at a URL, read the scored report.
- 1Clone and install
- 2Run the scorer
npx @wentzel/specshift run https://docs.example.com --methodology=v1.0. Output is JSON + a Markdown report at./reports/[reportId].{json,md}. - 3Read the methodologyUnderstand what each sub-score means and what to fix first.
- 4Submit to the leaderboardAdd
--submit-leaderboardto opt your score into the public ranking.
03
Platform overview
Four scoring suites measure what matters for regulated documentation. Each suite has a public spec and a public limitations document.
Can a vector index answer realistic developer questions from these docs?
Can a tool-use agent complete a representative task using only these docs?
Are the docs organised so a model can navigate without context overflow?
Do the docs describe the platform's actual current behaviour?
04
Knowledge base
The Pragma knowledge base covers OSCAL authoring, FedRAMP control mapping, SSP Sprint methodology, and Specshift CLI reference. Knowledge base articles are published alongside engagements and updated each quarter.
Knowledge base content is in active development as part of the 2026 launch. Anchor-customer-facing articles are published before each SOW signs.
Dispute a methodology score or file an RFC? Contact us. Disputes are tracked publicly under PRAG/06.