Similar to This
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30965
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull ...
Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29864
Multi-column on Intel XMX matrix engines refactored by budiony · Pull ...
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30971
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request ...
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30640
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ...
GitHub - dhia528/llama-android: Run llama.cpp on Android with a native chat UI and OpenAI-compatible API
github.com/dhia528/llama-android
GitHub - dhia528/llama-android: Run llama.cpp on Android with a native ...
models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30928
models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request ...
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29778
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ...
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30459
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ...
GitHub - Agusx1211/llama-cpp-ds4f-m2-ultra: LLM inference in C/C++: LLM inference in C/C++. Contribute to Agusx1211/llama-cpp-ds4f-m2-ultra development by ...
github.com/Agusx1211/llama-cpp-ds4f-m2-ultra
GitHub - Agusx1211/llama-cpp-ds4f-m2-ultra: LLM inference in C/C++
GitHub - fewtarius/CachyLLama: LLM inference in C/C++: LLM inference in C/C++. Contribute to fewtarius/CachyLLama development by creating an account on GitHub.
github.com/fewtarius/CachyLLama
GitHub - fewtarius/CachyLLama: LLM inference in C/C++
Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/releases/tag/b9978
Release b9978 · ggml-org/llama.cpp
GitHub - linuxid10t/llama.cpp-add-laguna: LLM inference in C/C++: LLM inference in C/C++. Contribute to linuxid10t/llama.cpp-add-laguna development by creating ...
github.com/linuxid10t/llama.cpp-add-laguna
GitHub - linuxid10t/llama.cpp-add-laguna: LLM inference in C/C++
GitHub - RedToasty/llama.cpp_qts: Fixing --split-mode tensor, with different KV cache quantization types.
github.com/RedToasty/llama.cpp_qts
GitHub - RedToasty/llama.cpp_qts: Fixing --split-mode tensor ...
Release b8967 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/releases/tag/b8967
Release b8967 · ggml-org/llama.cpp
GitHub - Addy-ad/llama-cpp-turbo-planar-iso: Adding Turboquant + Planarquant + Isoquant to llama.cpp
github.com/Addy-ad/llama-cpp-turbo-planar-iso
GitHub - Addy-ad/llama-cpp-turbo-planar-iso: Adding Turboquant + ...
GitHub - TheTom/llama-cpp-turboquant: LLM inference in C/C++: LLM inference in C/C++. Contribute to TheTom/llama-cpp-turboquant development by creating an ...
github.com/TheTom/llama-cpp-turboquant
GitHub - TheTom/llama-cpp-turboquant: LLM inference in C/C++
Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20905
Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ...
GitHub - peva3/turboquant-h2o-streamingllm: Contribute to peva3/turboquant-h2o-streamingllm development by creating an account on GitHub.
github.com/peva3/turboquant-h2o-streamingllm
GitHub - peva3/turboquant-h2o-streamingllm
model: support GLM-OCR by ngxson · Pull Request #19677 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/19677
model: support GLM-OCR by ngxson · Pull Request #19677 · ggml-org/llama ...