RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp:

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/26610

RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Similar to This

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 08

ggml-cuda: assign four GDN state columns per warp by SongXiaoXi · Pull Request #30087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30087

0 similar articles

github.com Oct 02

CUDA: fuse shared experts into MMVQ by am17an · Pull Request #29184 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29184

0 similar articles

github.com Sep 20

CUDA: enable sparse fa for qwen4 by am17an · Pull Request #28770 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/28770

0 similar articles

github.com Sep 16

qwen4exp: add hc ops by am17an · Pull Request #28901 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/28901

0 similar articles

github.com Aug 21

llama: lfm2/lfm2moe: enable tensor split by cdanis · Pull Request #26993 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26993

0 similar articles

github.com Aug 02

DeepseekV4 MTP + DSpark by am17an · Pull Request #25784 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25784

0 similar articles

126

github.com Jun 29

DeepSeek V4 by am17an · Pull Request #24162 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on ...

github.com/ggml-org/llama.cpp/pull/24162

0 similar articles

github.com Jun 03

qwen35: use post-norm hidden state for MTP by am17an · Pull Request #24025 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24025

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com May 17

llama: avoid copying logits during prompt decode in MTP by am17an · Pull Request #23198 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23198

0 similar articles

github.com Apr 16

ggml: add graph_reused by am17an · Pull Request #21764 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/21764