llama.cpp/tools/server at master · ggml-org/llama.cpp:

LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/tree/master/tools/server

llama.cpp/tools/server at master · ggml-org/llama.cpp

Story Details

Last Updated
Total Articles	1

Main Topics

Game server

#game-server

server of game

Default (finance)

#default-finance

failure to meet the legal obligations of a loan or other financial contract

World model

#world-model

Similar to This

github.com Oct 18

GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

github.com/achyudh/llama.cpp

0 similar articles

159

github.com Oct 16

model : MTP support for Mellum2.1 by Xarbirus · Pull Request #30612 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30612

0 similar articles

github.com Oct 11

Runtime support for Prism Bonsai 2 27B by bri-prism · Pull Request #29600 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29600

0 similar articles

github.com Sep 23

GitHub - wnzn/semif-go: System One-style decision scoring over llama.cpp with multimodal input

github.com/wnzn/semif-go

0 similar articles

XDA

Credibility C

Sep 01

I turned my old phone into a local LLM server, and it handles productivity tasks better than I expected

xda-developers.com/i-turned-my-old-phone-into-a-local-llm-server/

0 similar articles

github.com Aug 27

feat: import qwen4exp (Qwen3.8-Flash-Next) support from upstream PR #27742 by giveen · Pull Request #324 · TheTom/llama-cpp-turboquant

github.com/TheTom/llama-cpp-turboquant/pull/324

1 similar article

github.com Aug 20

GitHub - mostlygeek/llama-swap: Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

github.com/mostlygeek/llama-swap

0 similar articles

github.com May 21

server: fix checkpoints creation by jacekpoplawski · Pull Request #22929 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22929

0 similar articles

github.com May 01

llama.cpp/docs/backend/snapdragon/README.md at master · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/blob/master/docs/backend/snapdragon/README.md

0 similar articles

github.com Apr 15

GitHub - ParmesanParty/llama.cpp: Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into ...

github.com/ParmesanParty/llama.cpp

0 similar articles

github.com Apr 01

llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21038

0 similar articles

github.com Feb 20

GitHub - peva3/SmarterRouter: SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching ...

github.com/peva3/SmarterRouter

0 similar articles

github.com Feb 16

GitHub - WayneCider/YourOwnPersonalJean-Luc: Your Own Personal Jean-Luc — a local AI coding agent powered by llama.cpp. No cloud, no API keys.

github.com/WayneCider/YourOwnPersonalJean-Luc

0 similar articles