llama.cpp/docs/multi-gpu.md at master · ggml-org/llama.cpp:

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub ...

github.com/ggml-org/llama.cpp/blob/master/docs/multi-gpu.md

llama.cpp/docs/multi-gpu.md at master · ggml-org/llama.cpp

Story Details

Last Updated
Total Articles	1

Main Topics

Graphics processing unit

#graphics-processing-unit-643f5ad2632e9

specialized electronic circuit; graphics accelerator

Cache (computing)

#cache-computing

computing component that transparently stores data so that future requests for that data can be served faster

Similar to This

github.com Oct 18

GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

github.com/achyudh/llama.cpp

0 similar articles

159

github.com Oct 16

model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

0 similar articles

XDA

Credibility C

Oct 16

I ran GLM 5.3, a 744-billion-parameter model, on my home lab, and the frontier suddenly feels a lot closer

xda-developers.com/you-can-run-a-744b-model-on-your-own-hardware/

1 similar article

github.com Oct 11

Runtime support for Prism Bonsai 2 27B by bri-prism · Pull Request #29600 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29600

0 similar articles

github.com Oct 03

GitHub - MohammadHaishemKhawaja/hashyy: A full, unpruned 177B MoE model at 11.5 tok/s on one 12 GB GPU. Expert streaming for llama.cpp ...

github.com/MohammadHaishemKhawaja/hashyy

0 similar articles

github.com Sep 23

GitHub - W61k3r/LexiPanel: Self-hosted control panel for local AI on your own GPU box: run llama.cpp chat models, stable-diffusion.cpp images and audio ...

github.com/W61k3r/LexiPanel

0 similar articles

XDA

Jun 15

Two old GPUs I salvaged are doing more AI work than a brand new $2000 card, and I won't be upgrading anytime soon

xda-developers.com/two-old-gpus-are-doing-more-ai-work-than-a-brand-new-card/

0 similar articles

github.com May 25

Misc. bug: Meta backend `ggml_context` pool exhaustion with `--split-mode tensor` · Issue #22404 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/issues/22404

0 similar articles

github.com May 01

llama.cpp/docs/backend/snapdragon/README.md at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md

0 similar articles

github.com Apr 15

GitHub - ParmesanParty/llama.cpp: Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into ...

github.com/ParmesanParty/llama.cpp