Repository navigation

Sync master with upstream ggml-org/llama.cpp (82bb48500) - #80

Merged

danielhanchen merged 721 commits into

masterfrom

sync-upstream-20260807

Aug 7, 2026

Merged

Sync master with upstream ggml-org/llama.cpp (82bb48500)#80
danielhanchen merged 721 commits into
masterfrom
sync-upstream-20260807

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 17, 2026
Commits on Jul 18, 2026
- llama-quant : exclude i32 ffn_gate_tid2eid routing table from quantization (#25787)
  devYRPauli
  authored
  4937ca8
- model: rotate injected K/V cache for DFlash (#25823)
  
  ruixiang63
  and
  ggerganov
  authored
  571d0d5
Commits on Jul 20, 2026
Commits on Jul 21, 2026
Commits on Jul 22, 2026
- Add support for Laguna XS.2 & M.1 (#25165)
  joerowell
  authored
  1f66c3c
- llama-arch: fix DeepSeek4 APE tensor op (#25945)
  helanfxz
  authored
  67b9b0e
- cuda: GET_ROWS quants (#25962)
  ServeurpersoCom
  authored
  c5a4a0b
- webgpu : add CONV_2D_DW (depthwise conv2d) kernel (#25847)
  m1el
  authored
  7347430
- ci : fix SYCL package shared library lookup (#25987)
  KyleHagy
  authored
  b4d6c7d
- ggml: enable PowerPC backend variants on AIX (#25983)
  shalinib-ibm
  authored
  3ce7da2
- Fix DeepSeek4 crafted template (#25414)
  pwilkin
  authored
  f534da2
- common: infer the speculative type from the draft repo sidecars (#25989)
  ServeurpersoCom
  authored
  6d5a910
- minor: fix reasoning preserve var for DS4 [no ci] (#25999)
  pwilkin
  authored
  e8e6c7a
- feat(ui): add symbolic math support to JS sandbox via nerdamer (#25948)
  
  rankaiyx
  and
  ServeurpersoCom
  authored
  61328e6
- mtmd: use RAII for setting and resetting non-causal attention (#25723)
  nikwen
  authored
  e0833bf
- hexagon: activation ops update (#25974)
  
  tboinovski1
  and
  max-krasnyansky
  authored
  0278d83
- CUDA: Improve NVFP4 W4A4 activation quantization (#25730)
  ORippler
  authored
  1a064ab
- ui: Add a "Default" option for the reasoning selector (#25846)
  ServeurpersoCom
  authored
  cf51256
- contrib: allow all AI-generated code in general (#26012)
  ngxson
  authored
  4310aa4
Commits on Jul 23, 2026
Commits on Jul 24, 2026
- hexagon: further improved pipeline of the core bits (L2, DMA, MM, FA) (#26049)
  max-krasnyansky
  authored
  0a50d99
- vendor: update subprocess.h (#26061)
  ngxson
  authored
  0cea362
- cohere2 moe template parser: enforce JSON schema for text responses if a response schema is provided (#26018)
  boondocklabs
  authored
  8f5ab83
- UI: Fix settings precedence, Factory < Admin (--ui-config-file) < Users (Settings panel) (#26002)
  ServeurpersoCom
  authored
  54ce507
- skill: create `add-new-model` and `code-review` (#26042)
  
  ngxson
  and
  pwilkin
  authored
  77095ee
- opencl: do not treat NULL-mask flash attention as causal (#25771)
  kumaal
  authored
  56a8386
- opencl: cache compiled cl_program binaries on disk (#26050)
  wanghqc
  authored
  ed7adbf
- HIP: remove rocWMMA FlashAttention (#26046)
  JohannesGaessler
  authored
  fa72aec
- llama: various bug fixes (#26051)
  ngxson
  authored
  298219f
- server: support "reasoning_effort": "none" in OAI API (#26045)
  pnb
  authored
  27209a5
- ui: fix MCP server display name conflicts in tools lists (#26011)
  ServeurpersoCom
  authored
  95a923a
- model: add GLM 5.2 Indexer support (#25407)
  
  pcuenca
  and
  fairydreaming
  authored
  88bfee1
- ui: remove render effects (#26083)
  ServeurpersoCom
  authored
  96013c5
- ui: reduce per-token render cost when streaming (#26053)
  
  Zach Winter
  and
  zachwinter
  authored
  555881e
Commits on Jul 25, 2026
Commits on Jul 26, 2026
- ggml-webgpu: Fix WASM compilation with OpenMP (#25943)
  reeselevine
  authored
  7cdd557
- ui: fix context gauge card regressions and land at the conversation end (#26099)
  ServeurpersoCom
  authored
  ff067f7
- opencl: fix fused RMS norm mul view offset (#26085)
  happyyzy
  authored
  42fc243
- model: Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support (#24908)
  
  authored
  b1d4c65
- mtmd: add GLM-5.2-Vision (#26126)
  
  ehartford
  and
  Eric Hartford
  authored
  af28502
- common: add `subproc.h` wrapper, disabled on android/ios (#26102)
  ngxson
  authored
  d2a8182
- ui: detect the conversation import format from file contents (#26121)
  ServeurpersoCom
  authored
  55b7d6c
- Keep Minimax's indexer tensors at F32 for speed and accuracy (#26144)
  bartowski1182
  authored
  7657a6c
- ui: fix system message edit box not expanding to fit content (#26006)
  pieroevcc
  authored
  d4d057b
- mtmd: fix android build (#26150)
  ngxson
  authored
  0d47ea7
- mtmd: Add Vision Support for Minimax-M3 (#25113)
  
  authored
  3d1c3a8
Commits on Jul 27, 2026
Commits on Jul 28, 2026
Commits on Jul 29, 2026
Commits on Jul 30, 2026
- mimo2: address MTP review feedback (#26228)
  tnhnyzc
  authored
  64d528b
- [UT] enhance UT to show all real unsupported backends (#25234)
  
  arthw
  and
  ggerganov
  authored
  a6a77bc
- ggml : Fix issue with kleidiai ci and stringop overflow warning (#26277)
  JonathanC-ARM
  authored
  32703b4
- ui: IndexedDB and Conversations data fixes (#26278)
  allozaur
  authored
  21a5f5b
- metal: fix memory unwire if model is freed without any GPU operations (#26082)
  
  nikwen
  and
  forforever73
  authored
  d0bfb19
- Remove custom cpu op from the M3 graph, express with stock ops (#26297)
  timkhronos
  authored
  b2f2216
- CUDA: add Q2_0 support (#25707)
  khosravipasha
  authored
  9b2a088
- ggml : bump version to 0.18.0 (ggml/1576)
  ggerganov
  committed
  6a4c335
- sync : ggml
  ggerganov
  committed
  9ebfc3a
- readme : refresh (#26280)
  ggerganov
  authored
  6b36c23
- ggml-cuda: Allow transpose-free gemmv computation (#26171)
  roberteg16
  authored
  e1a1abb
- tests : avoid building get-model.cpp many times (#26317)
  ggerganov
  authored
  47f686f
- llama-context : sync pending async copies before clearing embd_seq (#25676)
  o7si
  authored
  432d7ff
- Test support for alternative conv layout (#25617)
  pmaybank
  authored
  958d9c0
- vulkan: Support quantized concat (#25684)
  jeffbolznv
  authored
  ea63b4d
- server: support inp embd to generate next token (#26313)
  ngxson
  authored
  b4ca032
- mtmd: add lanczos resize method [no release] (#26341)
  ngxson
  authored
  5f55650
Commits on Jul 31, 2026
- ggml-webgpu: improve flash_attn_vec for quantized KV at long contexts (#25956)
  yomaytk
  authored
  8f4646a
- sycl: fuse RMS_NORM + MUL (#26015)
  Titaniumtown
  authored
  1553725
- [SYCL] Support q2 mul_mat (#26231)
  arthw
  authored
  a2be61d
- sycl : support dev2dev memcpy by DEV2DEV_MEMCPY_FORWARD (#26234)
  
  arthw
  and
  NeoZhangJianyu
  authored
  1c5b89f
- ggml-zendnn : group matmul direct API for mul_mat_id (#25918)
  z-sachin
  authored
  1e22599
- llama : enforce the same K and V cache types for DeepSeek V4; enable FA if V cache is quantized (#25871)
  
  fairydreaming
  and
  sszymczy
  authored
  69e62fc
- [SYCL] support the missed types in cpy (#26005)
  arthw
  authored
  d5d3e05
- SYCL: add oneMKL GEMM flash attention for XMX-accelerated prompt proc… (#25025)
  
  authored
  9d9a6d2
- cuda: extract Q2_0 elements via __byte_perm (#25603)
  dfriehs
  authored
  15e755f
- server: correct accepted tokens when need draft token replay (#26320)
  
  ruixiang63
  and
  ggerganov
  authored
  0005475
- vulkan: update vulkan sdk to 1.4.357.0 (#26303)
  jeffbolznv
  authored
  6f3c0a7
- llama : load MTP tensors only if they are really used (#26296)
  
  fairydreaming
  and
  sszymczy
  authored
  82dbc4f
- Support rotated kv cache quant (#26180)
  timkhronos
  authored
  a09d8ab
- mtmd: add n_embd_head (#26342)
  
  ngxson
  and
  shimmyshimmer
  authored
  db7d8b2
- vulkan: Introduce driver version check for Windows Intel GPU to mitigate crashing (#25192)
  rillomas
  authored
  eb41d50
- vulkan: add POOL_1D op (#25431)
  AnandPatil1
  authored
  876a432
Commits on Aug 1, 2026
- chat : enable tool call in thinking for DS4 (#26269)
  pwilkin
  authored
  ddd4ec1
- mtmd: add minicpmv46 downsample (#25993)
  tc-mb
  authored
  de69995
- cli : persist reasoning_content in chat history (#26362)
  ramicaza
  authored
  c629da5
- agents: clarify comment style and jinja knowledge (#26405)
  ngxson
  authored
  89482bd
- vendor : update BoringSSL to 0.20260730.0 (#26353)
  cabelo
  authored
  815a2a5
- vulkan: extend topk_moe fusion to support sqrt(softplus) (#26124)
  jeffbolznv
  authored
  a7a6d0d
- test: fix some CI errors (#26415)
  ngxson
  authored
  11924d4
Commits on Aug 2, 2026
- ggml-webgpu: add support for f16 repeat (#26307)
  yomaytk
  authored
  7a2db1a
- model : load MiMo V2 MTP tensors only if used (#26412)
  CISC
  authored
  75587a0
- sycl: fix classification of iGPUs (#26105)
  KyleHagy
  authored
  272700b
- chat : add qwen3 specialized parser (#26252)
  
  aldehir
  and
  bartdeboer
  authored
  f5919bf
- DeepseekV4 MTP + DSpark (#25784)
  am17an
  authored
  596a579
- opencl: bugfix increment ref_count in ggml_backend_opencl_init() (#26162)
  akleine
  authored
  c745be2
- convert: add option to create separate dspark GGUF (#26452)
  am17an
  authored
  3581ba0
- common: support the DSpark sidecar resolution (#26458)
  ServeurpersoCom
  authored
  bb4e0e1
- metal: implement DeepSeek V4 hyper-connections (#26459)
  
  ggerganov
  and
  tarruda
  authored
  fffbcbd
- opencl: limit local workgroup size for GLU operation (#26383)
  mgroeber9110
  authored
  0ab9d6f
- metal : add F16 support for bin ops (#26465)
  ggerganov
  authored
  9d21b57
- metal : add SILU_BACK (#25982)
  Blackcyan30
  authored
  221f0f6
Commits on Aug 3, 2026
- metal: implement DSv4 Lightning Indexer (#25893)
  
  authored
  1464c62
- llama : MTP support for DeepSeek V3.2 (#26457)
  
  fairydreaming
  and
  sszymczy
  authored
  2b63e06
- model: MTP support for Qwen3-Next (#25589)
  
  yomaytk
  and
  CISC
  authored
  4ed2b13
- server: (tools) add x-tool-cwd header (#26420)
  ngxson
  authored
  f2b52a8
- server: add notice for upcoming default port change 8080 --> 9931 (#26508)
  ngxson
  authored
  0b14b87
- CUDA: Fix data-races when reusing SMEM in block_reduce (#26385)
  ORippler
  authored
  9bd4c09
- CUDA: Add backend sampler for penalties sampler (#25262)
  kmorennv
  authored
  96278e3
- llama : allocate indexer cache only in "full" indexer layers (#26474)
  
  fairydreaming
  and
  sszymczy
  authored
  563dec8
- model: M3: Move MSA into a new memory implementation (#26338)
  
  timkhronos
  and
  ggerganov
  authored
  67d5978
- graph : fix unused input tensors in minimax m3 graph (#26519)
  ggerganov
  authored
  c50b34a
- opencl: route large q6_K lm_head to the flat GEMV (#26427)
  wanghqc
  authored
  39eab74
- ggml: use dynamic allocation for split graph inputs (#22789)
  
  AgoraPete
  and
  ggerganov
  authored
  dbadb68
- vocab : validate default special token ids (#26506)
  CISC
  authored
  e8e06f7
- server: add get_info tool (#26522)
  
  ngxson
  and
  ServeurpersoCom
  authored
  99111b1
- tests: add model resolution test on synthetic repo listings (#26172)
  
  ServeurpersoCom
  and
  ngxson
  authored
  ee0445c
- model : support MTP in GLM-4.7-Flash (#24868)
  jacekpoplawski
  authored
  57c0921
- vendor : update BoringSSL to 0.20260803.0 (#26523)
  cabelo
  authored
  fe2adf0
- vendor : update cpp-httplib to 0.52.0 (#26485)
  cabelo
  authored
  94bc47f
- chat : add new template for DeepSeek V4 Flash 0731 (#26398)
  tarruda
  authored
  0ef6e55
Commits on Aug 4, 2026
Commits on Aug 5, 2026
Commits on Aug 6, 2026
Commits on Aug 7, 2026

Commits

Commits on Jul 17, 2026

Commits on Jul 18, 2026

Commits on Jul 20, 2026

Commits on Jul 21, 2026

Commits on Jul 22, 2026

Commits on Jul 23, 2026

Commits on Jul 24, 2026

Commits on Jul 25, 2026

Commits on Jul 26, 2026

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

Commits on Jul 30, 2026