LLM Wiki on ChengAo Shen

📚 Reading Note for LLM Wiki

Thu, 28 May 2026 00:00:00 +0000

TL;DR: Let LLM maintain a persistent wiki by reading → extracting → integrating.

Why we need LLM Wiki? Link to heading

RAG is good, but we still need to retrives relevant chunks at every query time, that is not accumulation.

LLM wiki incrementally build and maintain a persistent wiki, that is a structured interlinked collection of markdown files.

How to use it? Link to heading

Three layer architecture Link to heading

Raw sources: immutable source of articles, papers, images, data files, etc.
Wiki: directory of LLM-generated markdown files. LLM owns this layer only.
Schema: the document that tells how LLM to build the Wiki. User and LLM can both change this document.

Three operations Link to heading

Ingest: Drop a new source into the raw collection, and tell LLM to process it.
Query: Ask the question against the wiki, LLM search for relevant pages, read them and synthesizes a anser with citations.

Good ansers can be filed back into the wiki as new pages.