Skip to content

Add pinned Spark-X2.5-4B GGUF on llama.cpp b10964 - #42

Closed
pirumpi wants to merge 1 commit into
feat/compact-llama-modelsfrom
feat/spark-x25
Closed

pirumpi wants to merge 1 commit into
feat/compact-llama-modelsfrom
feat/spark-x25

Conversation

@pirumpi

@pirumpi pirumpi commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds the official Spark-X2.5-4B Q4_K_M GGUF as a pinned, SHA-256-checked text model. Upgrades the bundled llama.cpp runtime to b10964, which adds Spark support, for both CLI release bundles and the desktop runtime downloader. This PR is stacked on #41 because it uses that PR's pinned-artifact validation.

Research date: 2026-09-18.

Validation

  • Verified official Hugging Face repository revision, exact file size, SHA-256, and Apache-2.0 license.
  • Verified SHA-256 and archive layout of the official b10964 runtime assets for macOS arm64, Windows x64/arm64, and Linux x64/arm64.
  • On Apple Silicon, loaded Spark on CPU and Metal and tested English and Chinese chat, reasoning on/off, tapioca pull cached-artifact validation, and tapioca serve chat.
  • Regression-smoked Phi-4 Mini and GLM-4.7-Flash Q8 on b10964 Metal.
  • go test ./..., catalog manifest validation, desktop runtime-asset test, and desktop TypeScript typecheck passed.

Not yet qualified

Windows/Linux Vulkan behavior, low-memory limits, structured tool use, and long context. Keep this PR draft and issue #38 open until those are validated. This runtime upgrade affects all GGUF models; broad regression through CI and review is required before release.

Sources

Related: #38. Do not auto-close on merge until platform qualification is complete.

@coderabbitai

coderabbitai Bot commented Sep 18, 2026

Copy link
Copy Markdown

Important

Draft PR not reviewed

Draft PRs are not automatically reviewed by default.

  • Trigger a manual review

To automatically review draft PRs, update your CodeRabbit configuration:

reviews:
  auto_review:
    drafts: true

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@pirumpi

pirumpi commented Sep 18, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by #43. The Spark work was moved onto released v0.12.0/main with MiniCPM5 and the current desktop runtime code; this stacked draft should not be merged.

@pirumpi pirumpi closed this Sep 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant