Similar to This
CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up rows by anujj · Pull Request #29948 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29948
CUDA: fuse FFN gate/up matmuls and GLU in MMQ with interleaved gate/up ...
model: DSV4.1 flash by am17an · Pull Request #31086 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/31086
model: DSV4.1 flash by am17an · Pull Request #31086 · ggml-org/llama.cpp
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30965
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull ...
Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29864
Multi-column on Intel XMX matrix engines refactored by budiony · Pull ...
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30971
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request ...
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30640
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ...
nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type by martin-cimmino · Pull Request #23343 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/23343
nemotron : support non-standard GQA, BPE tokenizer and domyn-small ...
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30914
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ...
mtmd: add cohere2 vision support by Terrencezzj · Pull Request #30062 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30062
mtmd: add cohere2 vision support by Terrencezzj · Pull Request #30062 · ...
CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30517
CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ...
model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30673
model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request ...
cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30296
cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request ...
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29778
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ...
model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30676
model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ...
model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30616
model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · ...
cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29353
cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ...
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30459
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ...
[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29416
[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ...
llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/21038
llama : rotate activations for better quantization by ggerganov · Pull ...