cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Central processing unit

#central-processing-unit

central computer component that executes instructions

Similar to This

github.com 9h

qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30965

0 similar articles

github.com Oct 22

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

0 similar articles

github.com Oct 22

Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29864

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

github.com Oct 22

nemotron : support non-standard GQA, BPE tokenizer and domyn-small pre-type by martin-cimmino · Pull Request #23343 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23343

0 similar articles

github.com Oct 22

webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30914

0 similar articles

github.com Oct 21

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30928

0 similar articles

github.com Oct 19

mtmd: add cohere2 vision support by Terrencezzj · Pull Request #30062 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30062

0 similar articles

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 17

model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30673

0 similar articles

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

github.com Oct 16

model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30676

0 similar articles

github.com Oct 15

model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30616

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

github.com Sep 26

ggml-cpu: tiled mul_mat for k-quants by jbooth · Pull Request #27851 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27851

0 similar articles

github.com Aug 19

llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26622

0 similar articles

github.com Apr 06

ggml: add Q1_0 1-bit quantization support (CPU) by khosravipasha · Pull Request #21273 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21273

0 similar articles