I turned my old phone into a local LLM server, and it handles productivity tasks better than I expected
xda-developers.com/i-turned-my-old-phone-into-a-local-llm-server/
Story Details
| Last Updated | |
| Total Articles | 1 |
Main Topics
telecommunications device that permits two or more users to conduct a conversation
Similar to This
Previous
github.com Oct 18
GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.
github.com/achyudh/llama.cpp
Ollama is the easiest way to start with local AI, and it's also the first thing I'd replace
xda-developers.com/ollama-easiest-way-start-with-local-ai-its-also-first-thing-id-replace/
github.com Oct 16
model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30612
I moved my local models from Ollama to llama.cpp, and the reason I stayed has nothing to do with speed
xda-developers.com/i-moved-from-ollama-to-llamacpp-and-discovered-its-better-than-most-tools/
github.com Sep 28
GitHub - solvingSteve/Gevva0: System 0 local decision gateway powered by Gemma 4. Direct logit scoring, KV-cache sequence branching ...
github.com/solvingSteve/Gevva0
I recycled an old Intel Arc card for a local LLM server, and the results were surprisingly decent
xda-developers.com/i-recycled-an-old-intel-arc-card-to-run-local-llms-and-the-results-were-surprisingly-decent/
github.com Sep 14
GitHub - fewtarius/CachyLLama-archived: LLM inference in C/C++: LLM inference in C/C++. Contribute to fewtarius/CachyLLama-archived development by creating an ...
github.com/fewtarius/CachyLLama-archived
I revived my old Windows 10 gaming PC as a llama.cpp server, and it’s good enough to handle everyday productivity tools
xda-developers.com/i-revived-my-old-windows-10-gaming-pc-as-a-llamacpp-server/
I replaced ChatGPT's free tier with a tiny local model running on my old laptop: It handles more daily tasks than its cloud-based rival
xda-developers.com/i-replaced-chatgpt-with-a-local-model-running-on-my-old-laptop/
I finally ditched Ollama after using llama.cpp's WebUI, and I'm not going back anytime soon
xda-developers.com/i-ditched-ollama-after-using-llama-cpp-webui-and-im-not-going-back/
github.com Jun 19
llama.cpp/tools/server at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
github.com/ggml-org/llama.cpp/tree/master/tools/server
Two old GPUs I salvaged are doing more AI work than a brand new $2000 card, and I won't be upgrading anytime soon
xda-developers.com/two-old-gpus-are-doing-more-ai-work-than-a-brand-new-card/
I ran local LLMs on Intel's cheapest iGPU, and the results were surprisingly decent
xda-developers.com/i-tried-running-llms-on-intels-cheapest-igpu/
I ran local LLMs on Intel's cheapest iGPU, and the results were surprisingly decent
xda-developers.com/i-tried-running-llms-on-intels-cheapest-igpu/
github.com May 21
server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/22929
github.com Apr 30
GitHub - Kaden-Schutt/hipfire: RDNA-native LLM inference engine in Rust.: RDNA-native LLM inference engine in Rust. . Contribute to Kaden-Schutt/hipfire ...
github.com/Kaden-Schutt/hipfire
I built a local LLM server I can access from anywhere, and it uses a Raspberry Pi
xda-developers.com/i-built-a-local-llm-server-i-can-access-from-anywhere/
Next