Bugs with Prompt Cache, Stopping, Thread Change · Issue #19760 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/19760

Story Details

Last Updated
Total Articles	1

Main Topics

slot

#slot

narrow, elongated hole or indentation made to accept only thin objects

Llama (language model)

#llama-language-model

large language model by Meta AI

Cache (computing)

#cache-computing

computing component that transparently stores data so that future requests for that data can be served faster

Similar to This

github.com Oct 25

qwen: merge tensors on convert by am17an · Pull Request #31028 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/31028

1 similar article

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Aug 20

AVX2: Speed up large batch size prompt processing of IQ models by bartowski1182 · Pull Request #27402 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27402

0 similar articles

github.com Aug 15

[FR] Make GGML_CUDA_FA_ALL_QUANTS the default or add runtime warning for missing quantized FA kernels · Issue #24485 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/24485

0 similar articles

github.com Aug 13

ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion by jinzihao · Pull Request #26947 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26947

0 similar articles

github.com Aug 03

model : support MTP in GLM-4.5-Air by jacekpoplawski · Pull Request #26534 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26534

0 similar articles

github.com Jul 24

GitHub - fewtarius/CachyLLama: LLM inference in C/C++: LLM inference in C/C++. Contribute to fewtarius/CachyLLama development by creating an account on GitHub.

github.com/fewtarius/CachyLLama

0 similar articles

github.com Jun 18

server : add last-5-seconds generation speed display by akx · Pull Request #24291 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24291

0 similar articles

github.com Jun 08

mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24282

0 similar articles

github.com May 21

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22929

0 similar articles

github.com May 17

llama: avoid copying logits during prompt decode in MTP by am17an · Pull Request #23198 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23198

0 similar articles

github.com May 15

What is wrong with llama.cpp release page?

github.com/ggml-org/llama.cpp/releases

0 similar articles

github.com Apr 07

kv-cache : support attention rotation for heterogeneous iSWA by ggerganov · Pull Request #21513 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21513

0 similar articles

github.com Apr 01

llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21038

0 similar articles

github.com Mar 10

server : speculative checkpointing by srogmann · Pull Request #19493 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19493

0 similar articles

github.com Mar 08

What's the difference between batch-size and ubatch-size? · ggml-org/llama.cpp · Discussion #6328

github.com/ggml-org/llama.cpp/discussions/6328

0 similar articles

github.com Mar 05

Eval bug: forcing full prompt re-processing in Qwen3-Coder-Next · Issue #19394 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/19394

0 similar articles

github.com Mar 03

Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20087

0 similar articles

github.com Feb 11

spec : add ngram-mod by ggerganov · Pull Request #19164 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/19164

0 similar articles