Similar to This
Previous
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30965

Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29864

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30971
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30640

GitHub - dhia528/llama-android: Run llama.cpp on Android with a native chat UI and OpenAI-compatible API
github.com/dhia528/llama-android

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30928

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29778

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30459

GitHub - Agusx1211/llama-cpp-ds4f-m2-ultra: LLM inference in C/C++: LLM inference in C/C++. Contribute to Agusx1211/llama-cpp-ds4f-m2-ultra development by ...
github.com/Agusx1211/llama-cpp-ds4f-m2-ultra

GitHub - fewtarius/CachyLLama: LLM inference in C/C++: LLM inference in C/C++. Contribute to fewtarius/CachyLLama development by creating an account on GitHub.
github.com/fewtarius/CachyLLama
Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/releases/tag/b9978

GitHub - linuxid10t/llama.cpp-add-laguna: LLM inference in C/C++: LLM inference in C/C++. Contribute to linuxid10t/llama.cpp-add-laguna development by creating ...
github.com/linuxid10t/llama.cpp-add-laguna
GitHub - RedToasty/llama.cpp_qts: Fixing --split-mode tensor, with different KV cache quantization types.
github.com/RedToasty/llama.cpp_qts

Release b8967 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/releases/tag/b8967

GitHub - Addy-ad/llama-cpp-turbo-planar-iso: Adding Turboquant + Planarquant + Isoquant to llama.cpp
github.com/Addy-ad/llama-cpp-turbo-planar-iso

GitHub - TheTom/llama-cpp-turboquant: LLM inference in C/C++: LLM inference in C/C++. Contribute to TheTom/llama-cpp-turboquant development by creating an ...
github.com/TheTom/llama-cpp-turboquant

Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20905

GitHub - peva3/turboquant-h2o-streamingllm: Contribute to peva3/turboquant-h2o-streamingllm development by creating an account on GitHub.
github.com/peva3/turboquant-h2o-streamingllm

model: support GLM-OCR by ngxson · Pull Request #19677 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/19677

Next
