GitHub - oussemah/llama.cpp at moe-cache-ousemma:

LLM inference in C/C++. Contribute to oussemah/llama.cpp development by creating an account on GitHub.

github.com/oussemah/llama.cpp/tree/moe-cache-ousemma

GitHub - oussemah/llama.cpp at moe-cache-ousemma

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Cache (computing)

#cache-computing

computing component that transparently stores data so that future requests for that data can be served faster

Similar to This

github.com Oct 22

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

github.com Oct 22

webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30914

0 similar articles

github.com Oct 22

GitHub - dhia528/llama-android: Run llama.cpp on Android with a native chat UI and OpenAI-compatible API

github.com/dhia528/llama-android

0 similar articles

github.com Oct 21

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30928

0 similar articles

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 16

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

github.com Sep 18

GitHub - Abzolute1/llama-cpp-optimization-lab: Source patches, experimental methods, and benchmark evidence for local llama.cpp MoE inference optimization.

github.com/Abzolute1/llama-cpp-optimization-lab

0 similar articles

github.com Sep 03

GitHub - mihailescu2m/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to mihailescu2m/llama.cpp development by creating an account on ...

github.com/mihailescu2m/llama.cpp

0 similar articles

github.com Aug 19

llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26622

0 similar articles

github.com Aug 01

GitHub - haraldh/llama.cpp at dspark-dsv4: LLM inference in C/C++. Contribute to haraldh/llama.cpp development by creating an account on GitHub.

github.com/haraldh/llama.cpp/tree/dspark-dsv4

0 similar articles

github.com Jul 24

GitHub - fewtarius/CachyLLama: LLM inference in C/C++: LLM inference in C/C++. Contribute to fewtarius/CachyLLama development by creating an account on GitHub.

github.com/fewtarius/CachyLLama

0 similar articles

github.com Jul 13

Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9978

3 similar articles

github.com Jun 13

Add arch support for cohere2-MoE by michaelw9999 · Pull Request #24260 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24260

0 similar articles

github.com May 28

GitHub - linuxid10t/llama.cpp-add-laguna: LLM inference in C/C++: LLM inference in C/C++. Contribute to linuxid10t/llama.cpp-add-laguna development by creating ...

github.com/linuxid10t/llama.cpp-add-laguna

0 similar articles

github.com May 15

What is wrong with llama.cpp release page?

github.com/ggml-org/llama.cpp/releases

0 similar articles

github.com Apr 03

GitHub - TheTom/llama-cpp-turboquant: LLM inference in C/C++: LLM inference in C/C++. Contribute to TheTom/llama-cpp-turboquant development by creating an ...

github.com/TheTom/llama-cpp-turboquant

0 similar articles

github.com Mar 29

Optimize MOE GEMV kernel for BS > 1. by gaugarg-nv · Pull Request #20905 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20905

0 similar articles