Document fragment link table and indexed strands - #52
isomorphisms wants to merge 3 commits into
Conversation
|
User-story / architecture checkpoint; this is deliberately not an implementation request yet. Two different use cases need to stay visible while the fragment/link/strand design evolves. 1. Original browser-size / render-latency storyThe original motivation was roughly: why is the browser so large, and why does it take so long to render anything? The intended shape was to keep only a very small moving frontier warm — approximately the current material plus 3–5 likely successors — and leave the rest durable/on disk. The present fragment note has the conceptual stages ( The fragment architecture should be judged partly by whether it permits:
The upcoming Grease native-call work ( A useful scale test remains the large-corpus story: ingest on the order of 100,000 documents/tabs/fragments and show that the reader's resident working set is still governed by the small warm frontier rather than corpus size. 2. Reading should be able to grow into a cross-document trail and then into workConcrete example from today:
The important question for IB is not whether that particular investigation should run automatically. It should not: at this point there is no job scope, acceptance boundary, cost/token budget, or estimate of how large the investigation would become. What IB should preserve is enough structure that this progression is cheap and natural:
This is a useful stress case for the distinction:
A strand must therefore be able to cross source-document boundaries. Document order remains one cheap special strand, not the definition of a strand. Questions to keep open
Treat these as acceptance/user-story constraints on later design work, not as a call to implement all of them in PR #52. |
Adds architecture notes for device-dependent fragment delivery, Pensive exposure observations, a persistent link table, multiply indexed adjacency, materialized strands, Android-friendly mmap/range reads, and composable shell queries. Adds a separate filesystem-index note for
~/from/<fragment>//~/to/<fragment>/projections, symlink-based edges, directory/filename indexing layers, and the rule that hot readers may compile those projections into compact mmap indexes. Also links the fragment design from the persistent storage model.