github.com Jun 26
vulkan: make TP viable by pwilkin · Pull Request #25051 · ggml-org/llama.cpp:
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/25051
Story Details
| Last Updated | |
| Total Articles | 1 |
Main Topics
Similar to This
Previous
github.com Oct 22
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30971
github.com Oct 22
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30914
github.com Sep 30
add GLM-5.3-Flash (GLM5-Next) support by timkhronos · Pull Request #27773 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/27773
github.com Sep 28
vulkan: fuse qwen4exp's SCALE -> SIGMOID -> SCALE -> hc_post chain by fxgsell · Pull Request #29520 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29520
github.com Sep 11
CUDA/HIP: Flash Attention tuning (gfx1201) by pwilkin · Pull Request #28102 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/28102
github.com Aug 01
chat: enable tool call in thinking for DS4 by pwilkin · Pull Request #26269 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/26269
github.com Jul 27
model: add Kimi-K3 text model by pwilkin · Pull Request #26185 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/26185
github.com Jul 10
Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/24179
github.com Jul 03
chat: trim messages sent to StepFun parser (fixes long reasoning loops) by pwilkin · Pull Request #25238 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/25238
github.com May 20
Move to backend sampling for MTP draft path by gaugarg-nv · Pull Request #23287 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/23287
github.com May 15
Refactor: convert_hf_to_gguf.py by pwilkin · Pull Request #17114 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/17114
github.com Apr 14
Release b8786 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/releases/tag/b8786
github.com Apr 09
vocab: add gemma4 tokenizer tests, fix edge case by pwilkin · Pull Request #21534 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/21534
github.com Apr 09
ggml: backend-agnostic tensor parallelism (experimental) by JohannesGaessler · Pull Request #19378 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/19378
github.com Apr 03
fix: Gemma4 tokenizer by pwilkin · Pull Request #21343 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/21343
github.com Mar 12
vulkan: add GATED_DELTA_NET op support by ProgenyAlpha · Pull Request #20334 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20334
github.com Mar 06
Autoparser: add optional argument reshuffle capability by pwilkin · Pull Request #20171 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20171
github.com Mar 03
Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20087
github.com Feb 14
Autoparser - complete refactoring of parser architecture by pwilkin · Pull Request #18675 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/18675
github.com Feb 08
[Model] Qwen3.5 dense and MoE support (no vision) by pwilkin · Pull Request #19435 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/19435
![[Model] Qwen3.5 dense and MoE support (no vision) by pwilkin · Pull ...](https://external-preview.redd.it/LP9lWJIkvOFwEJy7i2edxqBM2iBmROue3pUEdiXyxYg.png?width=320&crop=smart&auto=webp&s=5047d4820eeaabac9c913a090edcfe1c449b2979)
Next