GitHub - achyudh/llama.cpp: LLM inference in C/C++:

LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

Story Details

Last Updated
Total Articles	1

Main Topics

Large language model

#large-language-model

language model built with very large amounts of texts

Fork (software development)

#fork-software-development

new program, and line of software development, derived from an existing one

Similar to This

github.com Oct 16

model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

0 similar articles

XDA

Credibility C

Oct 15

I moved my local models from Ollama to llama.cpp, and the reason I stayed has nothing to do with speed

xda-developers.com/i-moved-from-ollama-to-llamacpp-and-discovered-its-better-than-most-tools/

1 similar article

XDA

Oct 16

I ran GLM 5.3, a 744-billion-parameter model, on my home lab, and the frontier suddenly feels a lot closer

xda-developers.com/you-can-run-a-744b-model-on-your-own-hardware/

1 similar article

github.com Sep 20

GitHub - edwardyoon/focus-llama: A llama.cpp fork for Dynamic Attention Masking: A llama.cpp fork for Dynamic Attention Masking. Contribute to ...

github.com/edwardyoon/focus-llama

0 similar articles

github.com Sep 18

GitHub - atretador/gfx906-16gb-expert-pool: LLM inference in C/C++: LLM inference in C/C++. Contribute to atretador/gfx906-16gb-expert-pool development by ...

github.com/atretador/gfx906-16gb-expert-pool

0 similar articles

github.com Aug 19

llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26622

0 similar articles

github.com Jul 26

Add MiniMax-M3 (MSA: MiniMax Sparse Attention) support by timkhronos · Pull Request #24908 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24908

1 similar article

XDA

Jul 19

Ollama is the easiest way to start local LLMs, but these 6 alternatives are also worth trying

xda-developers.com/ollama-alternatives-worth-trying/

1 similar article

github.com Jul 13

Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9978

3 similar articles

github.com May 21

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22929

0 similar articles

github.com May 20

llama : add Gemma4 MTP by am17an · Pull Request #23398 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/23398

0 similar articles

173

github.com Apr 15

GitHub - ParmesanParty/llama.cpp: Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into ...

github.com/ParmesanParty/llama.cpp

0 similar articles

github.com Apr 02

GitHub - philtomson/llama.cpp: LLM inference in C/C++ (fork of PrismML fork that enables CPU (incl AVX2 and AVX512) and ROCm for AMD GPUs

github.com/philtomson/llama.cpp

0 similar articles