ggml-cpu/ops: vectorize flash-attention V-cache F16 to F32 conversion by jinzihao · Pull Request #26947 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26947

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Data conversion

#data-conversion

conversion of digital data between formats

Similar to This

github.com Oct 25

qwen: merge tensors on convert by am17an · Pull Request #31028 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/31028

1 similar article

github.com Oct 23

qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30965

0 similar articles

github.com Oct 22

Multi-column on Intel XMX matrix engines refactored by budiony · Pull Request #29864 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29864

0 similar articles

github.com Oct 22

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Oct 15

model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30616

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Sep 26

ggml-cpu: tiled mul_mat for k-quants by jbooth · Pull Request #27851 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27851

0 similar articles

github.com Aug 20

spec : support DSpark for LFM2 models by tdakhran · Pull Request #27383 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27383

0 similar articles

github.com Jul 16

cuda: extract Q1_0 elements via __byte_perm by dfriehs · Pull Request #25628 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25628

0 similar articles

github.com Jul 09

ggml-hip: enable -funsafe-math-optimizations (#24668) · ggml-org/llama.cpp@ccb0c34

github.com/ggml-org/llama.cpp/commit/ccb0c3422394fbbfc28fd91f8c77111b748cfa09

2 similar articles

github.com Jul 02

[SYCL] Flash Attention with XMX engine via oneDNN graph API (SDPA) on KV f16; Qwen3.6-27b-Q8_0 prefill speed up x1.21 at p=512 and x4 ...

github.com/ggml-org/llama.cpp/pull/25222

0 similar articles

github.com Jun 05

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org/llama.cpp · Discussion #24102

github.com/ggml-org/llama.cpp/discussions/24102

0 similar articles

github.com May 20

Move to backend sampling for MTP draft path by gaugarg-nv · Pull Request #23287 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/23287

0 similar articles

github.com May 15

What is wrong with llama.cpp release page?

github.com/ggml-org/llama.cpp/releases

0 similar articles

github.com Apr 02

fix gguf conversion for audio/vision mmproj by ngxson · Pull Request #21309 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21309

0 similar articles

github.com Mar 28

Release b8498 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b8498

0 similar articles