spec: add DSpark speculative decoding by wjinxu · Pull Request #25173 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25173

Story Details

Last Updated
Total Articles	1

Main Topics

Handle

#handle

part of a device designed to be held

Llama (language model)

#llama-language-model

large language model by Meta AI

Similar to This

github.com Oct 16

model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

0 similar articles

github.com Oct 11

Runtime support for Prism Bonsai 2 27B by bri-prism · Pull Request #29600 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29600

0 similar articles

github.com Oct 06

metal : few-row MMA mat-mul and batched copies for speculative decoding by pratiknarola-t · Pull Request #29869 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29869

0 similar articles

github.com Aug 27

spec : add DFlash2 support (local convolution + candidate selector) by SubSir · Pull Request #27342 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27342

0 similar articles

github.com Aug 27

[feat] support dspark (Nanbeige4.2-3B) by zqlcode · Pull Request #27730 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27730

0 similar articles

github.com Aug 20

spec : support DSpark for LFM2 models by tdakhran · Pull Request #27383 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27383

0 similar articles

github.com Aug 02

DeepseekV4 MTP + DSpark by am17an · Pull Request #25784 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25784

0 similar articles

126

github.com Aug 01

GitHub - haraldh/llama.cpp at dspark-dsv4: LLM inference in C/C++. Contribute to haraldh/llama.cpp development by creating an account on GitHub.

github.com/haraldh/llama.cpp/tree/dspark-dsv4

0 similar articles

github.com Jul 14

model: add Hy3 (hy_v3) support with MTP speculative decoding by satindergrewal · Pull Request #25395 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25395

0 similar articles

github.com Jun 19

llama.cpp/tools/server at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/tree/master/tools/server

0 similar articles

github.com Jun 12

[Speculative decoding] feat: add EAGLE3 speculative decoding support by ruixiang63 · Pull Request #18039 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/18039

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com Apr 01

llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21038

0 similar articles

github.com Feb 11

spec : add ngram-mod by ggerganov · Pull Request #19164 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/19164

0 similar articles