llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Similar to This

github.com 12h

Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29864

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Oct 15

model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30616

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Sep 30

add GLM-5.3-Flash (GLM5-Next) support by timkhronos · Pull Request #27773 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27773

1 similar article

github.com Sep 11

CUDA/HIP: Flash Attention tuning (gfx1201) by pwilkin · Pull Request #28102 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/28102

0 similar articles

github.com Aug 19

llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26622

0 similar articles

github.com Aug 01

chat: enable tool call in thinking for DS4 by pwilkin · Pull Request #26269 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26269

0 similar articles

github.com Jul 27

model: add Kimi-K3 text model by pwilkin · Pull Request #26185 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26185

0 similar articles

github.com Jul 03

chat: trim messages sent to StepFun parser (fixes long reasoning loops) by pwilkin · Pull Request #25238 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25238

0 similar articles

github.com Jun 26

vulkan: make TP viable by pwilkin · Pull Request #25051 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25051

0 similar articles

github.com May 15

Refactor: convert_hf_to_gguf.py by pwilkin · Pull Request #17114 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/17114

0 similar articles

github.com Apr 09

vocab: add gemma4 tokenizer tests, fix edge case by pwilkin · Pull Request #21534 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21534

0 similar articles

161

github.com Apr 03

fix: Gemma4 tokenizer by pwilkin · Pull Request #21343 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/21343

0 similar articles

github.com Mar 06

Autoparser: add optional argument reshuffle capability by pwilkin · Pull Request #20171 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20171

0 similar articles

github.com Mar 03

Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20087

0 similar articles

github.com Feb 14

Autoparser - complete refactoring of parser architecture by pwilkin · Pull Request #18675 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/18675

0 similar articles

github.com Feb 08

[Model] Qwen3.5 dense and MoE support (no vision) by pwilkin · Pull Request #19435 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19435

0 similar articles