Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp:

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/29761

Qwen4Exp: add MTP by am17an · Pull Request #29761 · ggml-org/llama.cpp

Story Details

Last Updated
Total Articles	1

Main Topics

Handle

#handle

part of a device designed to be held

Large language model

#large-language-model

language model built with very large amounts of texts

Failure

#failure

state or event of not meeting a desired or intended objective

Similar to This

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 16

model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Sep 16

qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/28901

0 similar articles

github.com Aug 02

DeepseekV4 MTP + DSpark by am17an · Pull Request #25784 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25784

0 similar articles

126

github.com Jun 03

qwen35: use post-norm hidden state for MTP by am17an · Pull Request #24025 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24025

0 similar articles

github.com May 29

llama: use f16 mask for FA to save VRAM by am17an · Pull Request #23764 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23764

0 similar articles

github.com May 25

CUDA: add fast walsh-hadamard transform by am17an · Pull Request #23615 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23615

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com May 17

llama: avoid copying logits during prompt decode in MTP by am17an · Pull Request #23198 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23198

0 similar articles

github.com Apr 06

llama-bench: add `-fitc` and `-fitt` to arguments by am17an · Pull Request #21304 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21304

0 similar articles

github.com Feb 11

spec : add ngram-mod by ggerganov · Pull Request #19164 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/19164

0 similar articles