dasLLAMA portable tier: the tune framework optional, AOT and wasm64 builds, the storyteller in the browser - #3948

Merged

borisbat merged 43 commits into

bbatkin/dasllama-portable-tier

Sep 6, 2026

Commits on Sep 6, 2026

the portable-tier plan: dasLLAMA without the JIT crowns in three stages (no-LLVM build on reference bodies, an AOT example target, WASM64), with the kernel test coverage audit as stage 0 and the se…

borisbat
and
claude
committed
747868a
the four rulings owed from the is_nan arc: tests-cpp/REVIEW.das gains the gate that every set_source_files_properties path exists (a moved per-flag TU otherwise builds the ordinary way and stays gr…

borisbat
and
claude
committed
19bc49a
stage 0 of the portable tier: the kernel gates the portable path needs before any kernel moves - six new units (the tuned elementwise set, activations and fp32 GEMM, the q8q8 family promoted from t…

borisbat
and
claude
committed
3d71cb2
test_q8q8_family: the s16 plane's group3 form is bit-exact against the f32 plane on portable and envelope-bounded on a generated backend - the rebased tree stamps a different profile and the two st…

borisbat
and
claude
committed
efa727c
stage 1, wave 1: f16_cvt moves to daslib (37 requires follow; the JIT keys its half-convert intrinsics on the module name, which stays), the NEON tier's require in the engine takes the ?llvm/daslib…

borisbat
and
claude
committed
305ed7d
stage 1, wave 2: the six tune annotations become daslib shells (daslib/tune.das) that forward to the framework when dasLLVM is mounted and do nothing otherwise - the framework's classes turn into p…

borisbat
and
claude
committed
72f5201
stage 1, wave 3: aarch64_neon and x64_avx move to daslib beside f16_cvt - pure das, zero requires, recognized by module name - so the NEON tier and the generated families' reference bodies compile …

borisbat
and
claude
committed
f5bdfe5
run.das --no-tune runs its children with the image rail off: the reference policy is a different box identity, and a .dlim minted under it GC-purges the box's tuned images; test_audio_embedder's di…

borisbat
and
claude
committed
c0dd2c2
math_gen's [init] guards its one framework call (tune_suppress_mint) under static_if - the last unguarded llvm_tune symbol in the engine's kernel closure; without dasLLVM the q8q8 family, the prefi…

borisbat
and
claude
committed
64d24b0
the aarch64 SDOT and SMMLA tables gate on DotProd and i8mm, not the arch alone: a kernel-free -exe targets the generic ARMv8.0 machine, where a name-recognized sdot4 was a fatal Cannot select under…

borisbat
and
claude
committed
8a906b5
stage 2 of the portable tier: dasllama_aot, the daslang host with the CPU engine's C++ stubs linked in, reproduces the JIT reference run token-exact on SmolLM2; five general AOT fixes rode along

borisbat
and
claude
committed
9b7be37
typeinfo module_exists(X): the compiling program's own library, so a path-guarded das target answers the same inside a tool's nested compile; builtin_module_exists keeps its process-registry meaning

borisbat
and
claude
committed
d4bfb51
the llvm witness module: "no LLVM" is the build configuration's word, never the filesystem's - every LLVM guard is `require ?llvm`, and module_exists answers what is visible from the compiling module

borisbat
and
claude
committed
76d92d9
the plan's stage 3 drops the Vulkan-guard item: the tier already hangs off require ?vulkan in the transformer, verified with --disable-module dasvulkan; a model-free no-GPU-modules gate is owed onc…

borisbat
and
claude
committed
7b414ba
no tuning under a cross target, by construction: get_target_triple / get_target_architecture_name fold for the artifact a compile emits, the tune framework's inert gate fires on any --jit-target, a…

borisbat
and
claude
committed
3bc34cf
stage 3: dasLLAMA runs on WASM64 - the dasllama_aot target builds in the wasm64 web tree from the host-generated engine C++, and the node driver reproduces the JIT run token-exact on SmolLM2

borisbat
and
claude
committed
49c948d
the web build's embedded source trees exclude build residue: _aot_generated C++ and .jitted_scripts caches outweighed the .das files twenty to one, and rode into every wasm artifact - dasllama_aot …

borisbat
and
claude
committed
e0b3e57
the plan's stage 3 carries the artifact breakdown after the embed exclusions

borisbat
and
claude
committed
822577f
examples/dasLLAMA/speak.das: speak a line locally through the TTS facade and report audio seconds against synthesis seconds; the node driver passes script arguments verbatim with @model standing fo…

borisbat
and
claude
committed
362d5f0
the tune sidecar's module-cache pin moves out of the shared manifest reader into the stamping paths, so a standalone exe carries no ast_core extern; release wasm gains release_wasm_disable_module, …

borisbat
and
claude
committed
f523c76
the node driver sets the engine's knobs in preRun - emscripten builds the C environment from Module.ENV at startup, so a knob set after init never reaches getenv; the plan records the JIT-cross rai…

borisbat
and
claude
committed
5e69cc1
the storyteller: stories15M writes a children's story on screen two tokens a frame while KittenTTS reads each finished sentence aloud from its own thread; the jobque fork pool is per context, so th…

borisbat
and
claude
committed
4c435a8
the storyteller in the browser: its own web shell fetches the four model files into MEMFS and waits for the click audio needs, the release rail exports FS and ENV to shells; a fresh session sampled…

borisbat
and
claude
committed
c71e829
a TTS image serves without its gguf: the family's driver data (Kitten's speed priors and aliases, Kokoro's symbols) rides the image meta, load_tts_model takes a .dlim path on whichever lane the fil…

borisbat
and
claude
committed
8ad4747
the release rail forwards an app's own release_emcc_arg lines (only module packages' were gathered, so an app-level flag vanished silently); dasllama-convert arms the fork-context pool inside each …

borisbat
and
claude
committed
90896ef
the int8 dot on wasm: the JIT's signed idot family lowers to i32x4.relaxed_dot_i8x16_i7x16_add_s through the sign trick (extmul + pairwise adds where relaxed SIMD is absent), +relaxed-simd joins th…

borisbat
and
claude
committed
c6dc5e6
the American-only phoneme pack tts_g2p_en_us.bin (10.3 MB against the full pack's 14.0): build_g2p_data.py --dialect us drops the British values and prunes CMUdict of every word the American lexico…

borisbat
and
claude
committed
7bd180f
the TTS set's Hugging Face pin moves to the commit that carries tts_g2p_en_us.bin

borisbat
and
claude
committed
d3b787e
the layout stamp follows the rebase onto the Q8 token table: version 33 stays, the closure hash moves with the TTS image meta

borisbat
and
claude
committed
6051be3
the runner census after the rebase: test_chat sits in the stocked list alone, and the six kernel units get their area rows (five llm, the ASR tower one audio)

borisbat
and
claude
committed
3b84f84
dasllama.io gets an examples page: the storyteller card opens the wasm64 build on its own page under the site's nav; the model set is a rolling GitHub release the deploy downloads beside the page, …

borisbat
and
claude
committed
ea564c5
news on both sites: dasLLAMA runs in the browser - the storyteller compiled to wasm64 opens the dasllama.io examples page

borisbat
and
claude
committed
07a4164
the dasLLVM descriptor census admits the witness module registration: Module_LLVM is a .shared_module name, not a module file

borisbat
and
claude
committed
fb294df
the comment harvest and the formatter pass over the arc: four rules and four architecture sections land where the comments pointed, with their anchors and citations; the storyteller and the tests n…

borisbat
and
claude
committed
df4c579
the review-round fix batch: the framework is optional everywhere a portable program reaches it - the server, the bench, the profiling helpers and the modes fixture read the registry and the stamps …

borisbat
and
claude
committed
8ca7b8f
the gate residue of the fix batch: the two rules the folder gates parse come back (the Inline module list in src/builtin, the shipped-exe decision in daspkg), the two documents that crossed 300 lin…

borisbat
and
claude
committed
5dae7d7
the exe-rail residue: the llvm descriptor registers the llvm/daslib paths only with the witness, so a build without dasLLVM refuses a direct framework require instead of compiling it hollow; log_tu…

borisbat
and
claude
committed
e1bc2b1
the exe lint rail retires: an exe carries the host's module paths without the modules, so its lint world was never one in-tree files answered to - CI lints the changed set once through daslang, pre…

borisbat
and
claude
committed
e78657d
get_target_architecture_name's reference text lists what the function returns: arm64 for both arm triples, never aarch64

borisbat
and
claude
committed
1ccf6cc
the two remaining daslib-side doors to llvm/ spell the witness guard: das2rst and just_in_time compile in a build without dasLLVM - the docs lane's daslang carries none, and the interpreter sweeps …

borisbat
and
claude
committed
588aa9c
the descriptor path gate is withdrawn and the JIT emitter pin re-stamped: the llvm/daslib files resolve wherever modules/dasLLVM sits and only the witness decides the guards, because a static host …

borisbat
and
claude
committed
ba6f3f2
the daspkg name guard is an allowlist: letters, digits, underscore, dash and dot, never dot or dot-dot - the strings it admits are spliced unquoted into run_cmd lines, so a space split argv and a s…

borisbat
and
claude
committed
01ca6a2
the preview server decides the /examples/ sandbox by containment, not by pattern: the resolved real path must sit under the examples root, so a doubled slash, a dot-dot or a Windows drive-qualified…

borisbat
and
claude
committed
b1baf4b