|
| 1 | +# arXiv:2408.10592 — Hologram is a graph: theorems need matched witnesses |
| 2 | + |
| 3 | +**Paper:** Litian Huang, Xinguo Yu, Feng Xiong, Bin He, Shengbing Tang, Jiawen Fu (2024), *Hologram Reasoning for Solving Algebra Problems with Geometry Diagrams* |
| 4 | +**Primary source:** https://arxiv.org/abs/2408.10592 |
| 5 | +**PDF:** https://arxiv.org/pdf/2408.10592 |
| 6 | +**Author code:** https://github.com/FerretDoll/HGR |
| 7 | +**Source inspected:** arXiv v1, 9-page PDF (20 August 2024); method pp. 3–5; tables 1–3 p. 7; limitations p. 8 (PDF pages counted from 1). |
| 8 | +**Status:** SOURCE EXTRACTION + PROPOSED LANCE-GRAPH FALSIFIERS; no code port, benchmark or parity result implied. |
| 9 | + |
| 10 | +## Punchline |
| 11 | + |
| 12 | +> **Keep observations addressable; let theorems be independently declared consumers of the same graph. A fast candidate mask is not a proof: pattern binding and its constraints must still pass.** |
| 13 | +
|
| 14 | +This paper's word *hologram* denotes a **heterogeneous attributed geometry graph**, NOT HRR/FHRR, a phase-bound VSA, or distributed bit-vector superposition. Its real contribution is to make a collection of theorem templates reusable over a shared graph representation and to improve the *choice* of which template to attempt. |
| 15 | + |
| 16 | +Portable separation: |
| 17 | + |
| 18 | +~~~text |
| 19 | +text + diagram |
| 20 | + ↓ parse (may be wrong) |
| 21 | +graph G = primitives + relations + mathematical and visual attributes |
| 22 | + ↓ select theorem candidate (policy is a heuristic) |
| 23 | +match pattern under structural constraints |
| 24 | + ↓ enforce mathematical and visual constraints |
| 25 | + ├─ proving model: derive relationship ΔG |
| 26 | + └─ property model: derive equations E |
| 27 | + ↓ solve equations / update derivation state |
| 28 | +explicit theorem + operands + relation + equation + answer |
| 29 | +~~~ |
| 30 | + |
| 31 | +No unvalidated visual resemblance may silently become a mathematical theorem. |
| 32 | + |
| 33 | +## Paper extraction: concrete mechanism |
| 34 | + |
| 35 | +### H1. One global geometry graph with distinct attribute kinds (paper §Method / Hologram; PDF p. 3) |
| 36 | + |
| 37 | +Paper notation: \`G=(V,E,A,Â)\`. |
| 38 | + |
| 39 | +- \`V\`: points, lines, angles, arcs, circles, polygons. |
| 40 | +- \`E\`: geometric relations (incidence, adjacency, perpendicularity, parallelism, congruence, similarity). HGR uses an **undirected** graph for these relations. |
| 41 | +- \`A\`: measured / mathematical values including lengths, angles, areas and target attribute \`τ\`. |
| 42 | +- \`Â\`: diagram-derived visual cues such as approximate positions, apparent lengths and apparent angles. The paper explicitly excludes these from formal calculation; they help disambiguate candidate matches. |
| 43 | + |
| 44 | +The same \`G\` is read by distinct operations; the distinction between admissible mathematical facts and visual hints is a useful cross-consumer boundary. |
| 45 | + |
| 46 | +### H2. Theorem templates are first-class models (paper §Graph Model Construction; PDF pp. 4–5) |
| 47 | + |
| 48 | +There are two kinds of templates: |
| 49 | + |
| 50 | +~~~text |
| 51 | +proving model M_prov = (G_p, R, Ĉ, C, ΔG) |
| 52 | +property model M_prop = (G_p, R, Ĉ, E) |
| 53 | +~~~ |
| 54 | + |
| 55 | +- \`G_p\` is an attributed-agnostic *pattern graph* (for structural matching). |
| 56 | +- \`R\` is a readable relation template for the resulting explanation, not a freely inferred fact. |
| 57 | +- \`Ĉ\` denotes visual constraints used to resolve potential pattern ambiguity. |
| 58 | +- \`C\` denotes mathematical preconditions of a proving model. |
| 59 | +- \`ΔG\` introduces derived vertices, edges or attributes after proof. |
| 60 | +- \`E\` denotes equations a property model can generate. |
| 61 | + |
| 62 | +Proving a relationship and using an already-established relationship to form an equation are different operations. HGR's example first proves parallelism, then applies the parallelogram property. |
| 63 | + |
| 64 | +### H3. Structural matching is VF3, not a mere bitmap intersection (paper §Model Matching; PDF p. 5) |
| 65 | + |
| 66 | +Paper matcher seeks a mapping \`M: V_p → V_g\` preserving the graph's required structure and edge/non-edge relationships; the implementation uses VF3. |
| 67 | + |
| 68 | +After finding a mapping, HGR evaluates each mathematical constraint against the mapped primitives, then checks auxiliary visual constraints. Only successfully matched models may produce their outcomes. |
| 69 | + |
| 70 | +**Substrate distinction:** \`R = P_a & P_b & aperture\` can prune candidate addresses. It cannot *alone* certify a multi-vertex graph match, variable binding, required edge presence/absence, or numeric constraints. Any RelAlg / Datalog / Quack / R2IL lowering must preserve all of these. |
| 71 | + |
| 72 | +### H4. Iterate derivation, not just retrieval (paper §Reasoner; PDF pp. 5–6) |
| 73 | + |
| 74 | +A successful proving model produces \`G' = G + ΔG(M(V_p))\`. A successful property model adds instantiated equations to \`E_total\`. The solver evaluates \`E_total\`, updates available mathematical attributes, and repeats until target \`τ\` is reached. |
| 75 | + |
| 76 | +Graph Transformer embeddings encode current graph state for a DQN theorem-choice policy; they do not replace VF3 matching or numerical theorem checks. Learned scheduling and mathematical validity are different layers. |
| 77 | + |
| 78 | +### H5. Study scale and measured claims (paper §Implementation / §Evaluation; PDF pp. 6–7) |
| 79 | + |
| 80 | +- Geometry3K has **3,002** multiple-choice geometry problems, with text, diagram and parsing annotations. |
| 81 | +- Model pool: **13 proving** plus **51 property** models (64 total). |
| 82 | +- The paper's accuracy metric chooses the nearest multiple-choice answer to the solver's numeric output; when no output is produced, a random choice is made. Thus it is not a formal-proof-success rate. |
| 83 | +- HGR overall accuracy: **68.7%** using its parser; **89.6%** using ground-truth (GT) parsing. Do not report 89.6% as end-to-end. |
| 84 | +- With GT: GeoDRL baseline **89.4%**, Inter-GPS **78.3%**. |
| 85 | +- With GT: HGR averages **2.26 theorem applications**, **7.29 relations**, **17.55 equations** per solved problem (Table 2). |
| 86 | +- HGR uses a Graph Transformer + DQN theorem selector, pre-trained with heuristic/random selection samples. These components optimize search order, not the semantics of rules. |
| 87 | + |
| 88 | +Ablation with GT parsing (paper Table 3, PDF p. 7): |
| 89 | + |
| 90 | +| Configuration | Overall accuracy | |
| 91 | +|---|---:| |
| 92 | +| HGR complete | 89.6% | |
| 93 | +| Without theorem-selection agent | 83.4% | |
| 94 | +| Without proving models | 79.5% | |
| 95 | +| Without property models | **27.0%** | |
| 96 | +| Without mathematical constraints \`C\` | 73.6% | |
| 97 | +| Without visual constraints \`Ĉ\` | 63.1% | |
| 98 | + |
| 99 | +**Interpretation:** A theorem pool, formal applicability constraints, and rules that produce equations are consequential. The strongest ablation is property models, but percentages alone do not identify any improvement in the proposed lance-graph executor. |
| 100 | + |
| 101 | +### H6. Known boundaries (paper §Failure Case; PDF p. 8) |
| 102 | + |
| 103 | +The published system fails on tasks requiring auxiliary geometric constructions and some shaded-region area calculations. Finite prepared-theorem coverage is a limitation. A new theorem template is not equivalent to the ability to invent new mathematics. |
| 104 | + |
| 105 | +## Extraction → lance-graph design (our engineering hypotheses, NOT paper claims) |
| 106 | + |
| 107 | +### L1. Reuse a typed theorem consumer over canonical graph observations |
| 108 | + |
| 109 | +~~~text |
| 110 | +Observed geometry (immutable, source-positioned) |
| 111 | + ↓ ClassView / typed primitive and relation reading |
| 112 | +Candidate theorem |
| 113 | + ↓ symbolic simplification and presence masks |
| 114 | +Bound graph match |
| 115 | + ↓ structural + numerical preconditions |
| 116 | +Derived theorem witness + equations |
| 117 | + ↓ separate derived generation / virtual branch |
| 118 | +Replayable proof / answer |
| 119 | +~~~ |
| 120 | + |
| 121 | +Suggested logical representation; do not introduce new stored structs until a falsifier proves existing ClassView/SoA/Quack machinery insufficient: |
| 122 | + |
| 123 | +~~~text |
| 124 | +TheoremTemplate { |
| 125 | + pattern: typed relation predicates, |
| 126 | + required_edges: declared, |
| 127 | + prohibited_edges: declared, |
| 128 | + math_checks: exact or tolerance-typed predicates, |
| 129 | + visual_hints: candidate-ranking ONLY, |
| 130 | + conclusion: derivation recipe, |
| 131 | + explanation: operand-bound template |
| 132 | +} |
| 133 | +~~~ |
| 134 | + |
| 135 | +The source paper does not propose HHTL, SoA, masks, CE64, NAL or R2IL. |
| 136 | + |
| 137 | +### L2. Visual/heuristic evidence cannot certify the theorem |
| 138 | + |
| 139 | +\`Â\` can prioritize a match, but a proof certificate must be based on authorized structural/mathematical conditions. Example: two diagram lines *looking* parallel does not establish parallelism. |
| 140 | + |
| 141 | +This is analogous to \`Primed != Attended != Proven\`, but HGR itself does not define those categories. |
| 142 | + |
| 143 | +### L3. Preserve derivation provenance when updating a graph |
| 144 | + |
| 145 | +The paper updates its problem-local \`G\` in place. A replayable substrate can instead retain: |
| 146 | + |
| 147 | +~~~text |
| 148 | +input_version |
| 149 | +theorem_model_id + theorem_model_version |
| 150 | +bound_vertex_addresses / role assignments |
| 151 | +source relation witnesses |
| 152 | +structural and mathematical check results |
| 153 | +derived_relation_or_equation |
| 154 | +output_generation |
| 155 | +~~~ |
| 156 | + |
| 157 | +The expansion \`ΔG\` should be a **derived view or explicitly committed version**, never indistinguishable from the original diagram observations. |
| 158 | + |
| 159 | +### L4. Theorem selector is not the theorem executor |
| 160 | + |
| 161 | +For a fair comparison: hold exactly the same 64 models, theorem constraints, equation solver and parse output fixed; change *only* the candidate selection / execution path. Compare a heuristic model selector, HGR DQN (if reproducible), and optional information-gain scheduling separately. |
| 162 | + |
| 163 | +### L5. R2IL lowering has to preserve joins and graph isomorphism checks |
| 164 | + |
| 165 | +Mask-first candidate pruning may reduce loads; it is not a proof of VF3 parity. Multi-entity binding, edge labels, required absences, symmetry and numerical checks all need independently executable oracles. |
| 166 | + |
| 167 | +No claim of O(1) end-to-end VF3 elimination, no claimed speedup, and no speculative benchmark number. |
| 168 | + |
| 169 | +## Executable falsifier matrix (proposed, NOT SHIPPED) |
| 170 | + |
| 171 | +| ID | Experiment | Pass criterion | Falsifier | |
| 172 | +|---|---|---|---| |
| 173 | +| HGR-F01 | Port a tiny, explicit theorem pool: parallelism and parallelogram side relation | Same admissible matches and instantiated equations as trusted VF3 + reference numeric checker | Candidate masks report matches violating structural/math constraints | |
| 174 | +| HGR-F02 | Visual red herring: drawn parallel but no symbolic/numeric proof | No theorem-certified parallel relation merely from visual similarity | Visual cue upgrades guess to proven fact | |
| 175 | +| HGR-F03 | Proving vs property model separation | Proof conclusion and property equation appear in distinct provenance-qualified steps | Equation is emitted without the precondition or origin | |
| 176 | +| HGR-F04 | Same frozen graph, multiple legal lowerings | Identical bound match set, equations, terminal values and witness provenance | A lowering silently drops edge absence or argument bindings | |
| 177 | +| HGR-F05 | Replay a derivation on an immutable input version | Identical derived overlay; original graph byte-identical | Derived relation pollutes original observations | |
| 178 | +| HGR-F06 | Ordering/cost ablation against VF3 | Correctness parity first, then measure mask construction, candidate binds, scanned bytes, runtime | Speed claim based solely on candidate pruning, no full matching parity | |
| 179 | +| HGR-F07 | Novel problem requiring new auxiliary construction | Explicitly report unsupported template/construction | Unsupported branch silently fabricates theorem applicability | |
| 180 | + |
| 181 | +## Relation to arXiv:2606.24948 |
| 182 | + |
| 183 | +Read alongside [2606.24948](2606.24948_superposition_capacity_breaks_two_hop_retrieval.md). The same word “hologram” hides two different architectures: |
| 184 | + |
| 185 | +- 2408.10592: an explicitly attributed geometry graph plus theorem-pattern operations. |
| 186 | +- 2606.24948: superposed HRR/FHRR vectors queried by approximate unbinding. |
| 187 | + |
| 188 | +They cannot be ranked from reported accuracy alone: Geometry3K equation-solving with explicit theorems and FB15k-237 zero-shot link composition are different tasks. |
| 189 | + |
| 190 | +## Scope and evidence boundary |
| 191 | + |
| 192 | +**Directly extracted from paper:** geometry graph type, two theorem kinds, VF3/constraints, DQN policy, Geometry3K numbers, limitations. |
| 193 | +**Proposed by us:** HHTL address mapping, replay certificates, RelAlg/Datalog/Quack lowering, R2IL/mask-risc, CE64/admissibility, falsifiers. |
| 194 | +**Not tested here:** HGR reproduction, code import, solver correctness, mask-read latency, benchmark parity, neural policy transfer. |
| 195 | + |
| 196 | +**One-line criterion:** *A theorem is reusable because its applicability can be tested on newly bound evidence, not because a candidate resembles the theorem's picture.* |
0 commit comments