Skip to content

feat(org): Scheme macro objects in Rowan AOT - #18

Draft
GTrunSec wants to merge 226 commits into
mainfrom
codex/org-object-aot-completion
Draft

GTrunSec wants to merge 226 commits into
mainfrom
codex/org-object-aot-completion

Conversation

@GTrunSec

@GTrunSec GTrunSec commented Sep 26, 2026 •

Copy link
Copy Markdown
Contributor

Orgize keeps Org syntax and semantic interpretation in Scheme. Rust consumes source-backed syntax and Element projections, admits typed native responses, and exposes the public document/query interfaces. The cutover remains in progress; this draft does not claim complete parser replacement or merge readiness.

The current engine pins gerbil-parser to dd0719585d6d5e54f44beaa6877c95152e89c914 and the embedded FFI runtime to 1e4f1f65c7ff8e95fe764f2e8549fa9d92275db4. A POO strategy owns its derived helper descriptors and prepared event-fold program. Refining strategy slots derives the corresponding program, rather than retaining the original constructor's grammar. Native initialization belongs to exclusive process startup before worker or child creation.

Corpus execution batches syntax events and document metadata. Private metadata packets retain the existing Scheme document semantics, source order, per-document errors, strict response framing, and limits of 64 documents and 64 KiB of encoded fields. Oversized single-document configuration fields retain the existing individual call. Public contracts remain Version 1. Worker-local profiling transfers observations after join; overlapping duration sums are not caller wall time.

Producer-owned FFI bundles bind the exact source revision, target, runtime pin, parser identity, headers, ordered archives and file hashes. Downstream consumers validate and link the prebuilt Scheme program; missing or rejected bundles never trigger a Scheme rebuild. Producer CI relocates each bundle and reruns Rust tests with an absent program manifest before publication. The external-program runtime still compiles its small C lifecycle bridge, so this is not a completely compiler-free distribution.

Earlier macOS ARM64 validation at 33e49a7656f5bd83be1646f1152ea1714635133a:

  • 35 Rust tests passed; 85 explicitly initialized native unit cases and all 458 consumer cases completed successfully.
  • All 178 Scheme cases passed with HARNESS-OK and final OK; the failure control preserved its nonzero exit.
  • Five earlier build-support bundle-admission tests, formatting, diff checks and strict scoped Clippy passed. Redundant-borrow and test-condition lint cleanup preserves behavior.
  • The unchanged 2,000-file Plan Ledger performance gate remains failing. After other owned builds/tests finished, the profiled best-of-five result was 516.552292 ms against the existing 100 ms limit. Earlier concurrent sampling was also negative. These observations do not establish a stable performance improvement.

Exact-head CI and downstream artifact qualification remain open. ASP consumes this existing PR through its built-in Orgize submodule; no external Orgize provider synchronization, new Orgize PR, or merge into main is required.

Current delivery 11b95cd5b03394b9b3ae7d70fb800dd3f9aab93d also incorporates the concurrent shared-parser compiler update. FFI export carries static OpenSSL, zlib and SQLite archives instead of relying on producer library paths. All six current build-support admission tests pass, including missing and changed dependency archives. A local export attempt rejected missing static OpenSSL at obsolete library paths embedded in the installed SDK; this negative result is preserved, with no host-path discovery fallback.

Standalone bundle initialization at the earlier pin succeeds. Same-process composition with MRR exposes overlapping generated Scheme globals and fails module initialization. A combined consumer needs compatible module identities and one admitted lifecycle/program owner; independent producer tests or successful Rust linkage do not prove that boundary. Latest producer CI and current parser performance qualification are pending; earlier functional and 516.552292 ms performance observations are not promoted to current-head results.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant