Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 8 additions & 1 deletion CHANGELOG.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,13 @@
# Changelog

## Unreleased
## v0.8.67

llama.cpp stays at `785322d17`. **Behaviour change:** `LlamaCppEx.Model.load/2`
no longer forces `use_mmap: true`; with no load flag given, llama.cpp picks the
mode (it reads the file instead of mapping it on iGPUs such as GB10). Pass
`use_mmap: true` to keep the old behaviour. The `model_load` and
`speculative_init` NIFs changed signature, so this release ships new
precompiled NIFs.

Validated on two DGX Sparks (GB10, CUDA 13.0): the full suite with every
model tag on CUDA, an end-to-end run with three models resident, a model
Expand Down
2 changes: 1 addition & 1 deletion mix.exs
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,7 @@ end
defmodule LlamaCppEx.MixProject do
use Mix.Project

@version "0.8.66"
@version "0.8.67"
@source_url "https://github.com/nyo16/llama_cpp_ex"

def project do
Expand Down