GitHub - haraldh/llama.cpp at dspark-dsv4:

LLM inference in C/C++. Contribute to haraldh/llama.cpp development by creating an account on GitHub.

github.com/haraldh/llama.cpp/tree/dspark-dsv4

GitHub - haraldh/llama.cpp at dspark-dsv4

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Graphics processing unit

#graphics-processing-unit-643f5ad2632e9

specialized electronic circuit; graphics accelerator

Similar to This

github.com Oct 23

qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30965

0 similar articles

github.com Oct 22

Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29864

0 similar articles

github.com Oct 22

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

github.com Oct 22

webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30914

0 similar articles

github.com Oct 21

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30928

0 similar articles

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 16

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

0 similar articles

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

github.com Sep 10

GitHub - Inovello/llama.cpp at flashnext-e06: Branch ot-host-buft-mmap: pinned host memory for -ot overrides under mmap. - GitHub - Inovello/llama ...

github.com/Inovello/llama.cpp/tree/flashnext-e06

0 similar articles

github.com Aug 27

[feat] support dspark (Nanbeige4.2-3B) by zqlcode · Pull Request #27730 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27730

0 similar articles

github.com Aug 23

GitHub - oussemah/llama.cpp at moe-cache-ousemma: LLM inference in C/C++. Contribute to oussemah/llama.cpp development by creating an account on GitHub.

github.com/oussemah/llama.cpp/tree/moe-cache-ousemma

0 similar articles

github.com Aug 20

spec : support DSpark for LFM2 models by tdakhran · Pull Request #27383 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27383

0 similar articles

github.com Aug 02

DeepseekV4 MTP + DSpark by am17an · Pull Request #25784 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an ...

github.com/ggml-org/llama.cpp/pull/25784

0 similar articles

126

github.com Jul 13

Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9978

3 similar articles

github.com May 28

GitHub - linuxid10t/llama.cpp-add-laguna: LLM inference in C/C++: LLM inference in C/C++. Contribute to linuxid10t/llama.cpp-add-laguna development by creating ...

github.com/linuxid10t/llama.cpp-add-laguna

0 similar articles

github.com Apr 03

GitHub - TheTom/llama-cpp-turboquant: LLM inference in C/C++: LLM inference in C/C++. Contribute to TheTom/llama-cpp-turboquant development by creating an ...

github.com/TheTom/llama-cpp-turboquant

0 similar articles