github.com Oct 22
GitHub - dhia528/llama-android: Run llama.cpp on Android with a native chat UI and OpenAI-compatible API
github.com/dhia528/llama-android
Story Details
| Last Updated | |
| Total Articles | 1 |
Main Topics
operating system created by Google for use on mobile devices
Similar to This
Previous
github.com 19h
qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30965
github.com Oct 22
Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29864
github.com Oct 22
llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30971
github.com Oct 21
llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30640
github.com Oct 22
webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30914
github.com Oct 21
models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30928
github.com Oct 15
Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29778
github.com Oct 14
common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/30459
github.com Oct 10
[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29416
![[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ...](https://external-preview.redd.it/TbK3XVR6ASkdshlPBBilG4g95i2h7wYGzURwqT8Fmn4.png?width=320&crop=smart&auto=webp&s=02e9d6f9d18450296f10f55e9b66b1d79a133dfc)
github.com Oct 02
llama, server: add /v1/systemone API (models: laya, julia-1, lev, openjev, kev) by ngxson · Pull Request #29818 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/29818
github.com Jul 10
Initial ET backend by marty1885 · Pull Request #24179 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/24179
github.com Jun 24
ui: add opt-in run_javascript frontend tool by ServeurpersoCom · Pull Request #24244 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/24244
github.com Jun 15
UI/svg block rendering by ServeurpersoCom · Pull Request #24080 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/24080
github.com Jun 12
ui: PWA support by allozaur · Pull Request #23871 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...
github.com/ggml-org/llama.cpp/pull/23871
github.com Apr 22
GitHub - khimaros/mortar: minimal fill-in-the-middle autocomplete for vscode/codium, for use with llama.cpp infill or any openai-compatible server
github.com/khimaros/mortar
github.com Apr 09
ggml: backend-agnostic tensor parallelism (experimental) by JohannesGaessler · Pull Request #19378 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/19378
github.com Mar 31
GitHub - MartinCrespoC/QuantumLeap---Llama.cpp-TurboQuant: 🚀 Run any LLM on any hardware. 130% faster MoE inference with ExpertFlow + TurboQuant KV compression ...
github.com/MartinCrespoC/QuantumLeap---Llama.cpp-TurboQuant
github.com Mar 12
vulkan: add GATED_DELTA_NET op support by ProgenyAlpha · Pull Request #20334 · ggml-org/llama.cpp
github.com/ggml-org/llama.cpp/pull/20334
github.com Mar 05
GitHub - ollls/ScrapChat: Contribute to ollls/ScrapChat development by creating an account on GitHub.
github.com/ollls/ScrapChat
Next