本文へ移動
AI NEWS JOURNAL
llama.cpp releasesAI NEWS / JOURNAL

b11906

ggml-cpu:すべての型に対して、concatを1行のカーネルに書き直す(#31179) 各ターゲット行は、ソース0またはソース1から生成されるか、次元0の場合にはソース0の行に続いてソース1の行が続くため、単一のカーネルで全型をカバーできます。密度の高いソース行は、量子化された型を含めて、1回のmemcpyで処理され、ストライド付きのソースはコンパイル時に要素サイズが判明しているため、要素ごとにコピーされます。行はi2だけで分割するのではなくスレッド間で分割され、通常は1であるi2よりも効率的です。また、32要素ずつのタイル単位でコピーされます。転置されたソースの場合、外側のループで要素を順に走査するため、タイル内の各行は隣接するアドレスを読み取り、要素ごとにフルな行のストライドを飛ばすのではなくなります。test_concatやdelta-net conv入力のレイアウト、さらにその性能テスト用のケースに、転置されたbケースを追加してください。 **ウェブサイト:** - **証明書:** - **macOS/iOS:** - [macOS Apple Sili

翻訳に失敗したため原文を表示しています。

ggml-cpu : rewrite concat as one row kernel for all types (#31179)

Every dst row comes from src0 or src1, or for dim 0 from the row of

src0 followed by the row of src1, so a single kernel covers every

type: a dense source row is one memcpy, quantized types included,

and a strided source is copied element by element with the element

size known at compile time.

Rows are split across threads instead of i2 alone, which is often 1,

and are copied in tiles of 32: for a transposed source the elements

are walked in the outer loop, so the rows of a tile read neighboring

addresses instead of jumping a full row stride per element.

Add transposed b cases to test_concat, the layout of the delta-net

conv input, and a perf case for it.

**Website:**

-

**Attestations:**

-

**macOS/iOS:**

- [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-macos-arm64.tar.gz)

- macOS Apple Silicon (arm64, KleidiAI enabled) [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23780)

- [macOS Intel (x64)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-macos-x64.tar.gz)

- [iOS XCFramework](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-xcframework.zip)

**Linux:**

- [Ubuntu x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-x64.tar.gz)

- [Ubuntu arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-arm64.tar.gz)

- [Ubuntu s390x (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-s390x.tar.gz)

- [Ubuntu x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-vulkan-x64.tar.gz)

- [Ubuntu arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-vulkan-arm64.tar.gz)

- [Ubuntu x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-cuda-12.8-x64.tar.gz) - [CUDA 12.8 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-b11906-bin-ubuntu-cuda-12.8-x64.tar.gz)

- [Ubuntu x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-cuda-13.4-x64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-b11906-bin-ubuntu-cuda-13.4-x64.tar.gz)

- [Ubuntu arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-cuda-13.4-arm64.tar.gz) - [CUDA 13.4 libraries](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-b11906-bin-ubuntu-cuda-13.4-arm64.tar.gz)

- [Ubuntu x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-rocm-10.0-x64.tar.gz)

- [Ubuntu x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-openvino-2026.4.1-x64.tar.gz)

- [Ubuntu x64 (SYCL FP32)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-sycl-fp32-x64.tar.gz)

- [Ubuntu x64 (SYCL FP16)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-ubuntu-sycl-fp16-x64.tar.gz)

- [Linux arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-linux-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/linux.md)

**Android:**

- [Android arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-android-arm64.tar.gz)

- [Android arm64 (Snapdragon: CPU, Adreno GPU, Hexagon NPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-android-arm64-snapdragon.tar.gz) - [setup guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md)

**Windows:**

- [Windows x64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-cpu-x64.zip)

- [Windows arm64 (CPU)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-cpu-arm64.zip)

- [Windows arm64 (OpenCL Adreno)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-opencl-adreno-arm64.zip)

- [Windows x64 (CUDA 12)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-cuda-12.4-x64.zip) - [CUDA 12.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-bin-win-cuda-12.4-x64.zip)

- [Windows x64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-cuda-13.4-x64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-bin-win-cuda-13.4-x64.zip)

- [Windows arm64 (CUDA 13)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-cuda-13.4-arm64.zip) - [CUDA 13.4 DLLs](https://github.com/ggml-org/llama.cpp/releases/download/b11906/cudart-llama-bin-win-cuda-13.4-arm64.zip)

- [Windows x64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-vulkan-x64.zip)

- [Windows arm64 (Vulkan)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-vulkan-arm64.zip)

- [Windows x64 (OpenVINO)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-openvino-2026.4.1-x64.zip)

- [Windows x64 (SYCL)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-sycl-x64.zip)

- [Windows x64 (ROCm 10.0)](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-bin-win-rocm-10.0-x64.zip)

**openEuler:**

- [DISABLED](https://github.com/ggml-org/llama.cpp/pull/23705)

- openEuler x86 (310p)

- openEuler x86 (910b, ACL Graph)

- openEuler aarch64 (310p)

- openEuler aarch64 (910b, ACL Graph)

**UI:**

- [UI](https://github.com/ggml-org/llama.cpp/releases/download/b11906/llama-b11906-ui.tar.gz)

情報源

llama.cpp releases
← すべてのニュースへ