Skip to content

swift: pin mlx-swift-lm 3.31.13 and mlx-audio-swift 0.1.10 for Recursive Flint - #1150

Closed
Siddhesh2377 wants to merge 2 commits into
mainfrom
siddhesh/mlx-swift-lm-3.31.13
Closed

Siddhesh2377 wants to merge 2 commits into
mainfrom
siddhesh/mlx-swift-lm-3.31.13

Conversation

@Siddhesh2377

@Siddhesh2377 Siddhesh2377 commented Oct 21, 2026 •

Copy link
Copy Markdown
Collaborator

Moves the MLX pins so the SDK can run Recursive Flint (RecursiveSI/flint-int4).

The manifests and every Package.resolved are updated by hand to the new tags and revisions. I did not build or re-resolve, so the lockfiles still carry their old originHash; SwiftPM refreshes it on the next resolve. No runtime code changes: Flint loads through the generic MLX LLM path.

It also moves llama.cpp from runanywhere-b10453.8 to runanywhere-b10453.9 (core/VERSIONS and the version constants in the Swift, Kotlin and Flutter bindings), so the GGUF path can load Flint too. .9 adds the flint arch (upstream ggml-org/llama.cpp#30928, cherry-picked before it merged; RunanywhereAI/llama.cpp#6) and the pplx-decider v1.2 converter. It changes no public llama.cpp headers, so the engine code is untouched. I built rac_backend_llamacpp with the cpp-desktop-macos-arm64 preset against the new tag (Sherpa off), and libllama.a carries the Flint model. The unsloth flint-preview-UD-Q4_K_XL GGUF was tested separately on the fork build. iOS, Android and Windows were not built.


Summary by cubic

Pins mlx-swift-lm 3.31.13 and mlx-audio-swift 0.1.10, and bumps the llama.cpp pin to runanywhere-b10453.9, so the SDK can run Recursive Flint (RecursiveSI/flint-int4).

  • mlx-swift-lm 3.31.11 → 3.31.13: 3.31.12 adds Flint support and 3.31.13 declares its GLM tool-call format.
  • mlx-audio-swift 0.1.9 → 0.1.10 only re-pins mlx-swift-lm to 3.31.13; since it pins exactly, both move together.
  • llama.cpp runanywhere-b10453.8 → .9 adds the flint arch and the pplx-decider v1.2 converter; the binding version constants are updated to match.
  • Manifests and Package.resolved files are updated by hand; lockfiles keep their old originHash until the next SwiftPM resolve. No runtime code changes — Flint loads through the generic MLX LLM path.

Written for commit 9769f64. Summary will update on new commits.

View guided diff Turn on auto-fix

Summary by CodeRabbit

  • Chores
    • Updated bundled audio, language-model, and llama.cpp runtime components to newer versions.
    • Added support for Recursive Flint and the pplx-decider v1.2 converter through the updated llama.cpp runtime.
    • Updated package metadata and version information across supported Swift, Kotlin, and Flutter integrations.

@coderabbitai

coderabbitai Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 80c093f1-f21d-4d92-ae80-7c62ec45302f
📥 Commits

Reviewing files that changed from the base of the PR and between 6b77c5b and 9769f64.

📒 Files selected for processing: 4
  • bindings/flutter/packages/runanywhere_llamacpp/lib/llamacpp.dart
  • bindings/kotlin/modules/runanywhere-core-llamacpp/src/main/kotlin/com/runanywhere/sdk/llm/llamacpp/LlamaCPP.kt
  • bindings/swift/Sources/LlamaCPPRuntime/LlamaCPP.swift
  • core/VERSIONS

Included review availability: This review used your included allowance. Your plan provides up to 10 included reviews per hour; 8 remain after this review.

📝 Walkthrough

The pull request updates Swift MLX dependency pins and llama.cpp version references. It changes mlx-audio-swift to 0.1.10, mlx-swift-lm to 3.31.13, and llama.cpp to runanywhere-b10453.9.

Changes: Version pins

Layer / File(s) Summary
Update Swift dependency pins
Package.swift, bindings/swift/Package.swift
Both manifests pin mlx-audio-swift to 0.1.10 and mlx-swift-lm to 3.31.13.
Update llama.cpp version pins
core/VERSIONS, bindings/flutter/..., bindings/kotlin/..., bindings/swift/...
The llama.cpp metadata and public binding constants update from runanywhere-b10453.8 to runanywhere-b10453.9. core/VERSIONS documents Recursive Flint support and the pplx-decider v1.2 converter.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~5 minutes

Change: Feature

Suggested reviewers: sanchitmonga22

Merge Risk: ⚪ Minimal · up to 9769f

No actionable merge-blocking risk was identified in the dependency and runtime pin updates.

Pre-merge checks: Passed 4 · Failed 1

Failed Failed checks: 1 warning

Check name Status Explanation Resolution
Description check Warning The description gives a detailed and relevant summary of the dependency updates, rationale, manual lockfile changes, and performed testing. However, it does not follow the repository template and omit… Update the description to include all template sections. Mark the applicable change type, record testing and platform-specific testing results, add the applicable Swift SDK, Kotlin SDK, Flutter SDK, and Commons labels, complete the checklis…
Passed Passed checks: 4 passed
Check name Status Explanation
Title check Passed The title clearly identifies the primary change: pinning mlx-swift-lm 3.31.13 and mlx-audio-swift 0.1.10 for Recursive Flint.
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 4…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Docstring Coverage

Explanation

No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 4 files. (2 skipped: 2 unsupported.)

Full details: Description check

Explanation

The description gives a detailed and relevant summary of the dependency updates, rationale, manual lockfile changes, and performed testing. However, it does not follow the repository template and omits the required Type of Change, Testing, Labels, Checklist, and Screenshots sections. It also does not explicitly document applicable label and checklist selections.

Resolution

Update the description to include all template sections. Mark the applicable change type, record testing and platform-specific testing results, add the applicable Swift SDK, Kotlin SDK, Flutter SDK, and Commons labels, complete the checklist, and state that screenshots are not applicable if no UI changes exist.

✨ Finishing Touches
📝 Generate docstrings
  • Commit to this branch
  • Create a new PR
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@sanchitmonga22 sanchitmonga22 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Limited current-diff review of 9769f64: the two Swift manifests and five lockfiles consistently move mlx-swift-lm to 3.31.13 and mlx-audio-swift to 0.1.10, and the lockfile revisions match those repository tags. The llama.cpp pin and Swift/Kotlin/Flutter constants consistently move to runanywhere-b10453.9. No obvious blocking defect found in these scoped changes. The desktop-kit build and published 0.20.42 assets are verified; that release is this head plus the kit-version-only commit. This approval is not a claim of all-green CI or independently validated Flint generation: swift-spm and native_win_x64_and_package were still running, and MLX/GGUF runtime statements remain author evidence. Existing reviewer and branch requirements still apply.

@sanchitmonga22

Copy link
Copy Markdown
Contributor

Closing as superseded by #1153, which moves past every pin here (llama.cpp runanywhere-b10453.10, mlx-swift-lm 3.31.14, mlx-audio-swift 0.1.11). The DevTools/example/decision-cli Package.resolved bumps from this PR are requested on #1153. Reopen if anything here is still needed.

— labubu for Sanchit

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants