model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

Story Details

Last Updated
Total Articles	1

Main Topics

Handle

#handle

part of a device designed to be held

Large language model

#large-language-model

language model built with very large amounts of texts

Similar to This

github.com 21h

Strata/docs/QWEN36.md at main · Niko1221/Strata: Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine ...

github.com/Niko1221/Strata/blob/main/docs/QWEN36.md

1 similar article

github.com Oct 18

GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

github.com/achyudh/llama.cpp

0 similar articles

159

github.com Oct 11

Runtime support for Prism Bonsai 2 27B by bri-prism · Pull Request #29600 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29600

0 similar articles

github.com Oct 10

open-jet/megakernel at master · L-Forster/open-jet: Local coding agent + model runtime. Serves Qwen3.8-27B 1.5x faster than llama.cpp on an RTX 3090 ...

github.com/L-Forster/open-jet/tree/master/megakernel

0 similar articles

github.com Sep 16

Enable CUDA graph for MTP draft by gaugarg-nv · Pull Request #28549 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/28549

0 similar articles

github.com Aug 17

spec : add adaptive MTP draft depth (draft-mtp-adaptive) by stew675 · Pull Request #27210 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27210

0 similar articles

github.com Aug 03

model : support MTP in GLM-4.5-Air by jacekpoplawski · Pull Request #26534 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26534

0 similar articles

github.com Aug 03

model: MTP support for Qwen3-Next by yomaytk · Pull Request #25589 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25589

0 similar articles

github.com Aug 02

DeepseekV4 MTP + DSpark by am17an · Pull Request #25784 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25784

0 similar articles

126

github.com Jul 14

model: add Hy3 (hy_v3) support with MTP speculative decoding by satindergrewal · Pull Request #25395 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25395

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com May 19

llama : MTP clean-up by ggerganov · Pull Request #23269 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23269

0 similar articles

github.com Apr 01

llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21038

0 similar articles