Enable CUDA graph for MTP draft by gaugarg-nv · Pull Request #28549 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/28549

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Similar to This

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 08

ggml-cuda: assign four GDN state columns per warp by SongXiaoXi · Pull Request #30087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30087

0 similar articles

github.com Sep 20

CUDA: enable sparse fa for qwen4 by am17an · Pull Request #28770 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/28770

0 similar articles

github.com Aug 17

spec : add adaptive MTP draft depth (draft-mtp-adaptive) by stew675 · Pull Request #27210 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27210

0 similar articles

github.com Aug 03

model : support MTP in GLM-4.5-Air by jacekpoplawski · Pull Request #26534 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26534

0 similar articles

github.com Jul 14

Enhance ggml_cuda_mul_mat_cublas with compute type fallback by theIvanR · Pull Request #25680 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25680

0 similar articles

github.com Jun 10

Remove padding and multiple D2D copies for MTP by gaugarg-nv · Pull Request #24086 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24086

0 similar articles

github.com Jun 08

mtp: support for gemma-4 E2B and E4B assistants by max-krasnyansky · Pull Request #24282 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24282

0 similar articles

github.com Jun 05

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org/llama.cpp · Discussion #24102

github.com/ggml-org/llama.cpp/discussions/24102

0 similar articles

github.com Jun 03

qwen35: use post-norm hidden state for MTP by am17an · Pull Request #24025 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24025

0 similar articles

github.com Jun 03

Release b9495 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9495

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com May 20

Move to backend sampling for MTP draft path by gaugarg-nv · Pull Request #23287 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23287

0 similar articles

github.com May 19

llama : MTP clean-up by ggerganov · Pull Request #23269 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23269

0 similar articles

github.com Mar 29

Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20905

0 similar articles

github.com Feb 14

models : optimizing qwen3next graph by ggerganov · Pull Request #19375 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19375

0 similar articles