GitHub - edwardyoon/focus-llama: A llama.cpp fork for Dynamic Attention Masking:

A llama.cpp fork for Dynamic Attention Masking. Contribute to ...

Story Details

Last Updated
Total Articles	1

Main Topics

Attention

#attention

behavioral and cognitive process of selectively concentrating on a discrete aspect of information, whether deemed subjective or objective, while ignoring other perceivable information

server computer

#server-computer

computing device intended for use as a server by a business

Fork (software development)

#fork-software-development

new program, and line of software development, derived from an existing one

Similar to This

github.com Oct 18

GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

github.com/achyudh/llama.cpp

0 similar articles

159

XDA

Credibility C

Oct 17

Ollama is the easiest way to start with local AI, and it's also the first thing I'd replace

xda-developers.com/ollama-easiest-way-start-with-local-ai-its-also-first-thing-id-replace/

1 similar article

XDA

Oct 15

I moved my local models from Ollama to llama.cpp, and the reason I stayed has nothing to do with speed

xda-developers.com/i-moved-from-ollama-to-llamacpp-and-discovered-its-better-than-most-tools/

1 similar article

XDA

Oct 16

I ran GLM 5.3, a 744-billion-parameter model, on my home lab, and the frontier suddenly feels a lot closer

xda-developers.com/you-can-run-a-744b-model-on-your-own-hardware/

1 similar article

github.com Oct 13

GitHub - hardenedlinux/SonicBoom: Contribute to hardenedlinux/SonicBoom development by creating an account on GitHub.

github.com/hardenedlinux/SonicBoom

0 similar articles

github.com Oct 11

Runtime support for Prism Bonsai 2 27B by bri-prism · Pull Request #29600 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29600

0 similar articles

github.com Oct 10

open-jet/megakernel at master · L-Forster/open-jet: Local coding agent + model runtime. Serves Qwen3.8-27B 1.5x faster than llama.cpp on an RTX 3090 ...

github.com/L-Forster/open-jet/tree/master/megakernel

0 similar articles

github.com Oct 07

focus-llama/README.md at master · edwardyoon/focus-llama: A llama.cpp fork for Dynamic Attention Masking. Contribute to edwardyoon/focus-llama development by ...

github.com/edwardyoon/focus-llama/blob/master/README.md

0 similar articles

github.com Sep 18

GitHub - atretador/gfx906-16gb-expert-pool: LLM inference in C/C++: LLM inference in C/C++. Contribute to atretador/gfx906-16gb-expert-pool development by ...

github.com/atretador/gfx906-16gb-expert-pool

0 similar articles

github.com Aug 27

GitHub - ccebelenski/localagents: MCP server that delegates Claude Code agent work to local models (llama.cpp / vLLM) on your own hardware

github.com/ccebelenski/localagents

0 similar articles

github.com May 21

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22929

0 similar articles

github.com May 16

lucebox-hub/megakernel at main · Luce-Org/lucebox-hub: Lucebox optimization hub: hand-tuned LLM inference, built for specific consumer hardware ...

github.com/Luce-Org/lucebox-hub/tree/main/megakernel

0 similar articles

github.com May 01

llama.cpp/docs/backend/snapdragon/README.md at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md

0 similar articles

github.com Apr 15

GitHub - ParmesanParty/llama.cpp: Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into ...

github.com/ParmesanParty/llama.cpp

0 similar articles

github.com Apr 14

GitHub - ag88/llama.cpp-model-runner: runmodel.sh a simple model launcher for llama.cpp / llama-server

github.com/ag88/llama.cpp-model-runner

0 similar articles