Eval bug: forcing full prompt re-processing in Qwen3-Coder-Next · Issue #19394 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/19394

Story Details

Last Updated
Total Articles	1

Main Topics

slot

#slot

narrow, elongated hole or indentation made to accept only thin objects

Llama (language model)

#llama-language-model

large language model by Meta AI

Glitch

#glitch

short-lived fault in a technical system

Similar to This

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Aug 20

AVX2: Speed up large batch size prompt processing of IQ models by bartowski1182 · Pull Request #27402 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27402

0 similar articles

github.com Aug 03

model: MTP support for Qwen3-Next by yomaytk · Pull Request #25589 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25589

0 similar articles

github.com Jul 02

[SYCL] Flash Attention with XMX engine via oneDNN graph API (SDPA) on KV f16; Qwen3.6-27b-Q8_0 prefill speed up x1.21 at p=512 and x4 ...

github.com/ggml-org/llama.cpp/pull/25222

0 similar articles

github.com Jun 18

server : add last-5-seconds generation speed display by akx · Pull Request #24291 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24291

0 similar articles

github.com Jun 08

mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24282

0 similar articles

github.com Jun 05

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org/llama.cpp · Discussion #24102

github.com/ggml-org/llama.cpp/discussions/24102

0 similar articles

github.com May 21

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22929

0 similar articles

github.com Mar 10

server : speculative checkpointing by srogmann · Pull Request #19493 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19493

0 similar articles

github.com Mar 03

Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20087

0 similar articles

github.com Feb 21

common : merge qwen3-coder and nemotron nano 3 parsers by aldehir · Pull Request #19765 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19765

0 similar articles

github.com Feb 20

Bugs with Prompt Cache, Stopping, Thread Change · Issue #19760 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/19760

0 similar articles

github.com Feb 11

spec : add ngram-mod by ggerganov · Pull Request #19164 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/19164

0 similar articles

github.com Feb 09

[MODEL] support qwen3.5 series by JJJYmmm · Pull Request #19468 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19468

0 similar articles

github.com Feb 08

[Model] Qwen3.5 dense and MoE support (no vision) by pwilkin · Pull Request #19435 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19435

0 similar articles

github.com Feb 09

Release b7973 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b7973

0 similar articles