Repository navigation
Bump llama.cpp to 9daa0aa22, release v0.8.69 - #126
Merged
Merged
Conversation
163 commits from a691b2345 (b12205) to b12361+7; llama.cpp and ggml are now 1.0.0. The upstream prune (#30565, #29801) removes no API the NIF calls. decision.cpp is "Ported at" 9daa0aa22 with no hunk to port. decision_compare.exs: ALL MATCH on 9 models against llama-server. - RPC protocol 8.0.1 -> 10.0.0 (#29413, #29801): workers and clients must both run v0.8.69. The HELLO layout is unchanged, so rpc_probe_hello only moves its static_assert to 10. - #30415 stops upstream registration aborting on a dead endpoint. The NIF keeps its probe (connect timeout, memoized endpoints); docs and the solution note say so. rpc-add-server-no-abort is superseded; rpc-client-spin-wait conflicts with #29413. - Record :mtp_cancel at this commit (4/7 abort, logits != nullptr).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bumps llama.cpp from
a691b2345(b12205) to9daa0aa22(b12361+7), 163 commits. Upstream is now llama.cpp 1.0.0 / ggml 1.0.0. Version → v0.8.69.NIF / API
llama.hfunction,llama_context_params.defrag_tholdand several ggml ops. The NIF calls none of them. NextN/DFlash queries move fromsrc/llama-ext.htollama.hunchanged.llama_model_default_paramsis unchanged.src/llama-vocab.cpponly drops deprecated wrappers (thetokenizer_st_partitionand BOS/EOS rules are untouched), andtools/server/server-decision.*is untouched, soinput_tokenize.cppand the decision port need no change.decision.cppis now "Ported at"9daa0aa22.GGML_OP_COUNT102 → 99). Workers and clients must both run v0.8.69. The HELLO layout is unchanged, sorpc_probe_helloonly moves itsstatic_assertto 10.docs/dgx-spark.md,docs/release-guide.mdand the solution note are updated.rpc-add-server-no-abortis superseded;rpc-client-spin-waitnow conflicts with #29413.Verification (M1 Max, Metal)
mix teston a default build (442 passed) and on anLLAMA_RPC=1build (442 passed), plus--include rpc_liveagainst a localRPC.Serverworker (443 passed).:smoke :embeddings :slow :mtp :tools(607 passed), embeddinggemma-2:embeddings,:decision,:decision_clef,:mtp_sidecar(Qwen3.8-27B) andtest/vm_exit_test.exs: all green.scripts/decision_compare.exs: ALL MATCH on 9 models againstllama-serverat the same commit.:mtp_cancel(known broken): 4 of 7 runs abort withGGML_ASSERT(logits != nullptr). Recorded intest/mtp_model_test.exs.mix format --check-formattedandmix dialyzer: clean.mix hex.build, unpacked,LLAMA_BACKEND=cpu mix compileclones9daa0aa22b8a…(= submodule) and builds.