ggml : add NVFP4 quantization type support by richarddd · Pull Request #19769 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/19769

Story Details

Last Updated
Total Articles	2

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Handle

#handle

part of a device designed to be held

Similar to This

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 17

model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30673

0 similar articles

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

0 1

github.com Oct 16

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

0 similar articles

github.com Oct 16

model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30676

0 similar articles

github.com Oct 15

model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30616

0 similar articles

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

github.com Oct 08

ggml-cuda: assign four GDN state columns per warp by SongXiaoXi · Pull Request #30087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30087

0 similar articles

github.com Sep 16

Release b11003 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b11003

0 similar articles

github.com Sep 06

[Model] Support for Spark2_5ForCausalLM implementation by KnightYao · Pull Request #27868 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27868

0 similar articles

github.com Aug 03

model: MTP support for Qwen3-Next by yomaytk · Pull Request #25589 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/25589

0 similar articles

github.com Jun 13

Add arch support for cohere2-MoE by michaelw9999 · Pull Request #24260 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/24260

0 similar articles

github.com May 15

What is wrong with llama.cpp release page?

github.com/ggml-org/llama.cpp/releases

0 similar articles

github.com May 07

feat: Add Mimo v2.5 model support by AesSedai · Pull Request #22493 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/22493

0 similar articles

github.com Apr 07

TurboQuant - Extreme KV Cache Quantization · ggml-org/llama.cpp · Discussion #20969

github.com/ggml-org/llama.cpp/discussions/20969

0 similar articles

github.com Apr 06

ggml: add Q1_0 1-bit quantization support (CPU) by khosravipasha · Pull Request #21273 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21273

0 similar articles

github.com Apr 06

model : add HunyuanOCR support by richarddd · Pull Request #21395 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21395

0 similar articles

github.com Apr 01

llama : rotate activations for better quantization by ggerganov · Pull Request #21038 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21038

0 similar articles