本文へ移動
AI NEWS JOURNAL
llama.cpp releasesAI NEWS / JOURNAL

b11922

tests:訓練済みモデルに対するマルチシーケンス分割リプレイおよび部分状態のケースを修正(#31216)* tests:訓練済みモデルに対するマルチシーケンス分割リプレイを修正 ロールバック時のスナップショットは、ロールバックされた末尾をデコードしたグラフによって取得される一方で、参照コンテキストは異なるバッチ形状を持つ同じプレフィックスをデコードします。両者の状態は最後のビット部分で異なり、訓練済みモデルではリプレイされる各トークンごとにその差が拡大されます。各シーケンスの最初にリプレイされたトークンのみを比較し、その後、シーケンス1つ分だけの末尾が存在する前の状態を参照コンテキストに復元します。補助者:dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF(MacBook、M5 Max、128GB)* tests:分割リプレイにおいてビット単位で正確なシーケンス1の分離を要求 シーケンス状態の保存は常にビット損失なしとは限らず、SWAでマスクされたセルは保存されないため、残りの部分を再読み込みします

翻訳に失敗したため原文を表示しています。

tests : fix multi-seq split replay and partial-state cases for trained models (#31216)

* tests : fix multi-seq split replay against trained models

The rollback snapshot is captured by the graph that decoded the rolled-back

tail, while the reference context decodes the same prefix with different

batch shapes. The two states differ in the last bits and trained models

amplify the difference with every replayed token. Compare only the first

replayed token of each seq, then restore the rollback state into the

reference context before the seq-1-only tail.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

* tests : require bit-exact seq-1 isolation in split replay

The seq state save is not always bit-lossless - SWA-masked cells are not

saved - so reload the restored state back into the rollback context. That

way both contexts enter the seq-1-only tail with byte-identical memory,

including the cell layout, and the tail logits must match bit-exact. Also

assert that the restored state round-trips bit-identical.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

* tests : drop the n_swa partial-state check from ps

The check keys off llama_model_n_swa(), which returns 0 for dsv4 even

though its raw KV cache has a 128-cell sliding window. The partial state

grows with the tokens there by design, so the flatness check is wrong.

Keep the partial <= full invariant.

Assisted-by: dsh:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

**Website:**

-

**Attestations:**

-

**macOS/iOS:**

- [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-macos-arm64.tar.gz)

- macOS Apple Silicon (arm64, KleidiAI enabled) [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23780)

- [macOS Intel (x64)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-macos-x64.tar.gz)

- [iOS XCFramework](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-xcframework.zip)

**Linux:**

- [Ubuntu x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-x64.tar.gz)

- [Ubuntu arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-arm64.tar.gz)

- [Ubuntu s390x (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-s390x.tar.gz)

- [Ubuntu x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-vulkan-x64.tar.gz)

- [Ubuntu arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-vulkan-arm64.tar.gz)

- [Ubuntu x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-12.8-x64.tar.gz) - [CUDA 12.8 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-12.8-x64.tar.gz)

- [Ubuntu x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-13.4-x64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-13.4-x64.tar.gz)

- [Ubuntu arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-cuda-13.4-arm64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-b11922-bin-ubuntu-cuda-13.4-arm64.tar.gz)

- [Ubuntu x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-rocm-10.0-x64.tar.gz)

- [Ubuntu x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-openvino-2026.4.1-x64.tar.gz)

- [Ubuntu x64 (SYCL FP32)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-sycl-fp32-x64.tar.gz)

- [Ubuntu x64 (SYCL FP16)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-ubuntu-sycl-fp16-x64.tar.gz)

- [Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-linux-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md)

**Android:**

- [Android arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-android-arm64.tar.gz)

- [Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-android-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md)

**Windows:**

- [Windows x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cpu-x64.zip)

- [Windows arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cpu-arm64.zip)

- [Windows arm64 (OpenCL Adreno)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-opencl-adreno-arm64.zip)

- [Windows x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-12.4-x64.zip) - [CUDA 12.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-12.4-x64.zip)

- [Windows x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-13.4-x64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-13.4-x64.zip)

- [Windows arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-cuda-13.4-arm64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11922/cudart-llama-bin-win-cuda-13.4-arm64.zip)

- [Windows x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-vulkan-x64.zip)

- [Windows arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-vulkan-arm64.zip)

- [Windows x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-openvino-2026.4.1-x64.zip)

- [Windows x64 (SYCL)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-sycl-x64.zip)

- [Windows x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-bin-win-rocm-10.0-x64.zip)

**openEuler:**

- [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23705)

- openEuler x86 (310p)

- openEuler x86 (910b, ACL Graph)

- openEuler aarch64 (310p)

- openEuler aarch64 (910b, ACL Graph)

**UI:**

- [UI](https://github.com/ggml-org/llama.cpp/releases/download/b11922/llama-b11922-ui.tar.gz)

情報源

llama.cpp releases
← すべてのニュースへ