Skip to content

Commit fc527a4

Browse files
authored
Merge pull request #1601 from AdaWorldAPI/docs/arxiv-hologram-two-mechanisms-2026-10-17
docs(arxiv): extract HGR theorem patterns and HRR retrieval bottleneck
2 parents 6cd3386 + bc73c8d commit fc527a4

2 files changed

Lines changed: 366 additions & 0 deletions
Lines changed: 196 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,196 @@
1+
# arXiv:2408.10592 — Hologram is a graph: theorems need matched witnesses
2+
3+
**Paper:** Litian Huang, Xinguo Yu, Feng Xiong, Bin He, Shengbing Tang, Jiawen Fu (2024), *Hologram Reasoning for Solving Algebra Problems with Geometry Diagrams*
4+
**Primary source:** https://arxiv.org/abs/2408.10592
5+
**PDF:** https://arxiv.org/pdf/2408.10592
6+
**Author code:** https://github.com/FerretDoll/HGR
7+
**Source inspected:** arXiv v1, 9-page PDF (20 August 2024); method pp. 3–5; tables 1–3 p. 7; limitations p. 8 (PDF pages counted from 1).
8+
**Status:** SOURCE EXTRACTION + PROPOSED LANCE-GRAPH FALSIFIERS; no code port, benchmark or parity result implied.
9+
10+
## Punchline
11+
12+
> **Keep observations addressable; let theorems be independently declared consumers of the same graph. A fast candidate mask is not a proof: pattern binding and its constraints must still pass.**
13+
14+
This paper's word *hologram* denotes a **heterogeneous attributed geometry graph**, NOT HRR/FHRR, a phase-bound VSA, or distributed bit-vector superposition. Its real contribution is to make a collection of theorem templates reusable over a shared graph representation and to improve the *choice* of which template to attempt.
15+
16+
Portable separation:
17+
18+
~~~text
19+
text + diagram
20+
↓ parse (may be wrong)
21+
graph G = primitives + relations + mathematical and visual attributes
22+
↓ select theorem candidate (policy is a heuristic)
23+
match pattern under structural constraints
24+
↓ enforce mathematical and visual constraints
25+
├─ proving model: derive relationship ΔG
26+
└─ property model: derive equations E
27+
↓ solve equations / update derivation state
28+
explicit theorem + operands + relation + equation + answer
29+
~~~
30+
31+
No unvalidated visual resemblance may silently become a mathematical theorem.
32+
33+
## Paper extraction: concrete mechanism
34+
35+
### H1. One global geometry graph with distinct attribute kinds (paper §Method / Hologram; PDF p. 3)
36+
37+
Paper notation: \`G=(V,E,A,Â)\`.
38+
39+
- \`V\`: points, lines, angles, arcs, circles, polygons.
40+
- \`E\`: geometric relations (incidence, adjacency, perpendicularity, parallelism, congruence, similarity). HGR uses an **undirected** graph for these relations.
41+
- \`A\`: measured / mathematical values including lengths, angles, areas and target attribute \`τ\`.
42+
- \`Â\`: diagram-derived visual cues such as approximate positions, apparent lengths and apparent angles. The paper explicitly excludes these from formal calculation; they help disambiguate candidate matches.
43+
44+
The same \`G\` is read by distinct operations; the distinction between admissible mathematical facts and visual hints is a useful cross-consumer boundary.
45+
46+
### H2. Theorem templates are first-class models (paper §Graph Model Construction; PDF pp. 4–5)
47+
48+
There are two kinds of templates:
49+
50+
~~~text
51+
proving model M_prov = (G_p, R, Ĉ, C, ΔG)
52+
property model M_prop = (G_p, R, Ĉ, E)
53+
~~~
54+
55+
- \`G_p\` is an attributed-agnostic *pattern graph* (for structural matching).
56+
- \`R\` is a readable relation template for the resulting explanation, not a freely inferred fact.
57+
- \`Ĉ\` denotes visual constraints used to resolve potential pattern ambiguity.
58+
- \`C\` denotes mathematical preconditions of a proving model.
59+
- \`ΔG\` introduces derived vertices, edges or attributes after proof.
60+
- \`E\` denotes equations a property model can generate.
61+
62+
Proving a relationship and using an already-established relationship to form an equation are different operations. HGR's example first proves parallelism, then applies the parallelogram property.
63+
64+
### H3. Structural matching is VF3, not a mere bitmap intersection (paper §Model Matching; PDF p. 5)
65+
66+
Paper matcher seeks a mapping \`M: V_p → V_g\` preserving the graph's required structure and edge/non-edge relationships; the implementation uses VF3.
67+
68+
After finding a mapping, HGR evaluates each mathematical constraint against the mapped primitives, then checks auxiliary visual constraints. Only successfully matched models may produce their outcomes.
69+
70+
**Substrate distinction:** \`R = P_a & P_b & aperture\` can prune candidate addresses. It cannot *alone* certify a multi-vertex graph match, variable binding, required edge presence/absence, or numeric constraints. Any RelAlg / Datalog / Quack / R2IL lowering must preserve all of these.
71+
72+
### H4. Iterate derivation, not just retrieval (paper §Reasoner; PDF pp. 5–6)
73+
74+
A successful proving model produces \`G' = G + ΔG(M(V_p))\`. A successful property model adds instantiated equations to \`E_total\`. The solver evaluates \`E_total\`, updates available mathematical attributes, and repeats until target \`τ\` is reached.
75+
76+
Graph Transformer embeddings encode current graph state for a DQN theorem-choice policy; they do not replace VF3 matching or numerical theorem checks. Learned scheduling and mathematical validity are different layers.
77+
78+
### H5. Study scale and measured claims (paper §Implementation / §Evaluation; PDF pp. 6–7)
79+
80+
- Geometry3K has **3,002** multiple-choice geometry problems, with text, diagram and parsing annotations.
81+
- Model pool: **13 proving** plus **51 property** models (64 total).
82+
- The paper's accuracy metric chooses the nearest multiple-choice answer to the solver's numeric output; when no output is produced, a random choice is made. Thus it is not a formal-proof-success rate.
83+
- HGR overall accuracy: **68.7%** using its parser; **89.6%** using ground-truth (GT) parsing. Do not report 89.6% as end-to-end.
84+
- With GT: GeoDRL baseline **89.4%**, Inter-GPS **78.3%**.
85+
- With GT: HGR averages **2.26 theorem applications**, **7.29 relations**, **17.55 equations** per solved problem (Table 2).
86+
- HGR uses a Graph Transformer + DQN theorem selector, pre-trained with heuristic/random selection samples. These components optimize search order, not the semantics of rules.
87+
88+
Ablation with GT parsing (paper Table 3, PDF p. 7):
89+
90+
| Configuration | Overall accuracy |
91+
|---|---:|
92+
| HGR complete | 89.6% |
93+
| Without theorem-selection agent | 83.4% |
94+
| Without proving models | 79.5% |
95+
| Without property models | **27.0%** |
96+
| Without mathematical constraints \`C\` | 73.6% |
97+
| Without visual constraints \`Ĉ\` | 63.1% |
98+
99+
**Interpretation:** A theorem pool, formal applicability constraints, and rules that produce equations are consequential. The strongest ablation is property models, but percentages alone do not identify any improvement in the proposed lance-graph executor.
100+
101+
### H6. Known boundaries (paper §Failure Case; PDF p. 8)
102+
103+
The published system fails on tasks requiring auxiliary geometric constructions and some shaded-region area calculations. Finite prepared-theorem coverage is a limitation. A new theorem template is not equivalent to the ability to invent new mathematics.
104+
105+
## Extraction → lance-graph design (our engineering hypotheses, NOT paper claims)
106+
107+
### L1. Reuse a typed theorem consumer over canonical graph observations
108+
109+
~~~text
110+
Observed geometry (immutable, source-positioned)
111+
↓ ClassView / typed primitive and relation reading
112+
Candidate theorem
113+
↓ symbolic simplification and presence masks
114+
Bound graph match
115+
↓ structural + numerical preconditions
116+
Derived theorem witness + equations
117+
↓ separate derived generation / virtual branch
118+
Replayable proof / answer
119+
~~~
120+
121+
Suggested logical representation; do not introduce new stored structs until a falsifier proves existing ClassView/SoA/Quack machinery insufficient:
122+
123+
~~~text
124+
TheoremTemplate {
125+
pattern: typed relation predicates,
126+
required_edges: declared,
127+
prohibited_edges: declared,
128+
math_checks: exact or tolerance-typed predicates,
129+
visual_hints: candidate-ranking ONLY,
130+
conclusion: derivation recipe,
131+
explanation: operand-bound template
132+
}
133+
~~~
134+
135+
The source paper does not propose HHTL, SoA, masks, CE64, NAL or R2IL.
136+
137+
### L2. Visual/heuristic evidence cannot certify the theorem
138+
139+
\`Â\` can prioritize a match, but a proof certificate must be based on authorized structural/mathematical conditions. Example: two diagram lines *looking* parallel does not establish parallelism.
140+
141+
This is analogous to \`Primed != Attended != Proven\`, but HGR itself does not define those categories.
142+
143+
### L3. Preserve derivation provenance when updating a graph
144+
145+
The paper updates its problem-local \`G\` in place. A replayable substrate can instead retain:
146+
147+
~~~text
148+
input_version
149+
theorem_model_id + theorem_model_version
150+
bound_vertex_addresses / role assignments
151+
source relation witnesses
152+
structural and mathematical check results
153+
derived_relation_or_equation
154+
output_generation
155+
~~~
156+
157+
The expansion \`ΔG\` should be a **derived view or explicitly committed version**, never indistinguishable from the original diagram observations.
158+
159+
### L4. Theorem selector is not the theorem executor
160+
161+
For a fair comparison: hold exactly the same 64 models, theorem constraints, equation solver and parse output fixed; change *only* the candidate selection / execution path. Compare a heuristic model selector, HGR DQN (if reproducible), and optional information-gain scheduling separately.
162+
163+
### L5. R2IL lowering has to preserve joins and graph isomorphism checks
164+
165+
Mask-first candidate pruning may reduce loads; it is not a proof of VF3 parity. Multi-entity binding, edge labels, required absences, symmetry and numerical checks all need independently executable oracles.
166+
167+
No claim of O(1) end-to-end VF3 elimination, no claimed speedup, and no speculative benchmark number.
168+
169+
## Executable falsifier matrix (proposed, NOT SHIPPED)
170+
171+
| ID | Experiment | Pass criterion | Falsifier |
172+
|---|---|---|---|
173+
| HGR-F01 | Port a tiny, explicit theorem pool: parallelism and parallelogram side relation | Same admissible matches and instantiated equations as trusted VF3 + reference numeric checker | Candidate masks report matches violating structural/math constraints |
174+
| HGR-F02 | Visual red herring: drawn parallel but no symbolic/numeric proof | No theorem-certified parallel relation merely from visual similarity | Visual cue upgrades guess to proven fact |
175+
| HGR-F03 | Proving vs property model separation | Proof conclusion and property equation appear in distinct provenance-qualified steps | Equation is emitted without the precondition or origin |
176+
| HGR-F04 | Same frozen graph, multiple legal lowerings | Identical bound match set, equations, terminal values and witness provenance | A lowering silently drops edge absence or argument bindings |
177+
| HGR-F05 | Replay a derivation on an immutable input version | Identical derived overlay; original graph byte-identical | Derived relation pollutes original observations |
178+
| HGR-F06 | Ordering/cost ablation against VF3 | Correctness parity first, then measure mask construction, candidate binds, scanned bytes, runtime | Speed claim based solely on candidate pruning, no full matching parity |
179+
| HGR-F07 | Novel problem requiring new auxiliary construction | Explicitly report unsupported template/construction | Unsupported branch silently fabricates theorem applicability |
180+
181+
## Relation to arXiv:2606.24948
182+
183+
Read alongside [2606.24948](2606.24948_superposition_capacity_breaks_two_hop_retrieval.md). The same word “hologram” hides two different architectures:
184+
185+
- 2408.10592: an explicitly attributed geometry graph plus theorem-pattern operations.
186+
- 2606.24948: superposed HRR/FHRR vectors queried by approximate unbinding.
187+
188+
They cannot be ranked from reported accuracy alone: Geometry3K equation-solving with explicit theorems and FB15k-237 zero-shot link composition are different tasks.
189+
190+
## Scope and evidence boundary
191+
192+
**Directly extracted from paper:** geometry graph type, two theorem kinds, VF3/constraints, DQN policy, Geometry3K numbers, limitations.
193+
**Proposed by us:** HHTL address mapping, replay certificates, RelAlg/Datalog/Quack lowering, R2IL/mask-risc, CE64/admissibility, falsifiers.
194+
**Not tested here:** HGR reproduction, code import, solver correctness, mask-read latency, benchmark parity, neural policy transfer.
195+
196+
**One-line criterion:** *A theorem is reusable because its applicability can be tested on newly bound evidence, not because a candidate resembles the theorem's picture.*

0 commit comments

Comments
 (0)