Skip to content

Run :tools in CI, filter llama.cpp debug logs, require elixir_make 0.10.1 - #114

Merged
nyo16 merged 1 commit into
masterfrom
ci-tools-log-level
Oct 31, 2026
Merged

nyo16 merged 1 commit into
masterfrom
ci-tools-log-level

Conversation

@nyo16

@nyo16 nyo16 commented Oct 31, 2026

Copy link
Copy Markdown
Owner

Follow-ups from v0.8.63.

CI coverage. CI now downloads a pinned unsloth/Qwen3.5-0.8B-GGUF Qwen3.5-0.8B-UD-Q4_K_XL.gguf (559 MB; sha256 identical to the file the tests were written on) and adds --include tools to the inference run, plus a "Tools tag runs alone" step. On the CPU backend locally, all 11 tool tests pass in 16 s.

Log noise. llama.cpp's default log callback writes every level, DEBUG included, to stderr. The NIF now installs its own when it loads. It filters by level, :info by default (everything as before minus DEBUG), handles CONT lines by their message's level, and also sets the chat-template logger's threshold. New LlamaCppEx.set_log_level/1 (:debug | :info | :warning | :error | :none) and config :llama_cpp_ex, log_level:, applied at application start. Measured on a 100-token Qwen3.5 tool call: :debug prints 1,663 stderr lines (41 "awaiting trigger"), default 199 (0), and :warning and :none print 0 when set before init.

elixir_make notice. Invalid option {max_header_size,65536} ignored is httpc on OTP patch releases that predate the option. OTP 29.0.6, 28.5.0.6 and 27.3.4.17 added it with a 10,240-byte default, and elixir_make 0.10.1 (elixir-lang/elixir_make#98) raises it because GitHub redirects can exceed that. Our requirement was ~> 0.8, which let users resolve an elixir_make whose download can fail on current OTP, so it is now ~> 0.10.1. Our redirect currently measures 5.6 KB, but that depends on the signed URL. README documents the notice.

Also: lock moves to decimal 3.2.0 and ecto 3.14.2, clearing two decimal advisories that mix deps.get reported (both optional deps).

Locally (Metal): default 436 passed; smoke+embeddings+slow+decision+tools on CI's models + Qwen3.5 601 passed; credo, dialyzer, format clean.

…10.1

- CI pins Qwen3.5-0.8B-UD-Q4_K_XL and runs --include tools on CPU.
- The NIF installs a level-filtering llama/ggml log callback, :info by
  default, with LlamaCppEx.set_log_level/1 and config :llama_cpp_ex, log_level.
- elixir_make ~> 0.10.1: newer OTP patches cap httpc headers at 10 KB.
- Lock: decimal 3.2.0 / ecto 3.14.2 for two decimal advisories.
@nyo16
nyo16 merged commit 8c5a65b into master Oct 31, 2026
9 checks passed
@nyo16
nyo16 deleted the ci-tools-log-level branch October 31, 2026 19:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant