Karpathy’s LLM Wiki

Andrej Karpathy’s pattern for building a persistent, compounding knowledge base as interlinked markdown files.

Key Contributions

• Introduced the three-layer architecture (raw, wiki, schema)
• Emphasized cross-referencing and consistency
• Focus on compounding knowledge rather than RAG

Related Concepts

• transformer-architecture - A key model architecture
• llm-wiki - The general pattern