Raw to Wiki Compilation
Raw to Wiki Compilation
The compiled page is the valuable form of a source, not the file left in a pile. Ingest is one source in, wiki pages better, an index row written, a log line appended. The source file stays as it arrived.
One source in
- Land the source in the inbox, the sources folder, or the private source folder when explicitly approved. The private folder is read-only for agents unless the user allows a write.
- Read notes/index.md, the Source Index (the register of what has been taken in), and recent
log.md. Also readnotes/catalog.mdbefore minting a page. Without the catalog, ingest mints duplicates. The catalog is agent-only, not a public page. - Extract metadata. The live set is title, author, URL, date, type, topic, and publication/privacy risk. License is still useful.
- Add or update the source row in the Source Index.
- Identify durable concepts and contradictions with existing pages.
- Create or update wiki pages for those concepts. Every page touched should become meaningfully better.
- Add backlinks between source notes, concepts, tools, people, papers, and workflows.
- Update notes/index.md only if a new hub or condensed page needs a front-door link. The catalog regenerates on build. The index is not a dump of every ingest.
- Append an ingest or compile entry to
log.md.
What must not happen
- Source files are not overwritten. They are immutable evidence.
- Long copyrighted text is not copied into public wiki pages.
- Wiki pages stay synthetic: explain, compare, connect, and cite.
- One source note per source.
- One wiki page per durable concept.
Ingest that pastes, ingest that mints a duplicate because the catalog was skipped, and a front door that lists every new page are the cases against. The price is metadata, a Source Index row, and a page made meaningfully better, not a dump. A new wiki page that is a long excerpt, or a second page for a concept that already has one, is the quit signal. The checkable residue is a Source Index row, an unchanged source file, and a log line.
The pile is still the pile. The wiki is what got more valuable.
Links into the knowledge base
- notes/index.md — front door. Updated only for a new hub or condensed link.
- LLM Knowledge Systems — the three-layer pattern.
- Wiki Health Checks — lint after ingest.
- Question Answering Against a Wiki — the query sibling.
Open Questions
When does a source stay uncompiled forever — cited, indexed, never turned into a page?
Sources
- AGENTS — live Ingest operation.
- LLM Knowledge Systems — the compiled-first pattern.