github.com Feb 28
spec : add ngram-mod by ggerganov · Pull Request #19164 · ggml-org/llama.cpp:
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/19164
Story Details
| Last Updated | |
| Total Articles | 2 |
Main Topics
Similar to This
Previous
NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks
venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks
github.com Oct 15
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29778
github.com Oct 14
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30459
github.com Oct 06
RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/26610
github.com Jun 19
llama.cpp/tools/server at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/tree/master/tools/server
github.com Jun 18
server : add last-5-seconds generation speed display by akx · Pull Request #24291 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/24291
github.com Jun 12
[Speculative decoding] feat: add EAGLE3 speculative decoding support by ruixiang63 · Pull Request #18039 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/18039
![[Speculative decoding] feat: add EAGLE3 speculative decoding support by ...](https://external-preview.redd.it/zRu_wUfy9Cp3Pp1kRAc-36MR3EQOz-NzxEdhKIKhhV0.png?width=320&crop=smart&auto=webp&s=ea4c0c659aa03218c535641bc82dfe86c6980667)
github.com Jun 08
mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/24282
github.com May 21
server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/22929
github.com May 20
llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/23398
github.com May 19
llama : MTP clean-up by ggerganov · Pull Request #23269 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/23269
github.com Apr 09
ggml: backend-agnostic tensor parallelism (experimental) by JohannesGaessler · Pull Request #19378 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/19378
github.com Apr 07
kv-cache : support attention rotation for heterogeneous iSWA by ggerganov · Pull Request #21513 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/21513
github.com Apr 01
llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/21038
github.com Mar 11
metal : add GDN kernel by ggerganov · Pull Request #20361 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating ...
github.com/ggml-org/llama.cpp/pull/20361
github.com Mar 05
Eval bug: forcing full prompt re-processing in Qwen3-Coder-Next · Issue #19394 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/issues/19394
github.com Mar 03
Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20087
github.com Feb 20
Bugs with Prompt Cache, Stopping, Thread Change · Issue #19760 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/issues/19760
github.com Feb 14
models : optimizing qwen3next graph by ggerganov · Pull Request #19375 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/19375
Next