What's the difference between batch-size and ubatch-size? · ggml-org/llama.cpp

github.com 2h

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

1

7

github.com Oct 19

mtmd: add cohere2 vision support by Terrencezzj · Pull Request #30062 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30062

0 similar articles

13

23

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

1

2

github.com Oct 17

model : add Kolibri-1 (Aleph-Alpha) support by riteme · Pull Request #30673 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30673

0 similar articles

2

1

VentureBeat

Credibility C

Oct 15

NVIDIA's Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarks

venturebeat.com/technology/nvidias-new-open-nemotron-3-5-super-vl-with-post-training-beats-claude-opus-5-gpt-6-1-sol-on-specialized-task-benchmarks

6 similar articles

1

0 1

github.com Oct 16

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

0 similar articles

3

2

github.com Oct 15

Add Support to maion-coder arch by mailkv23 · Pull Request #29778 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29778

0 similar articles

17

70

github.com Oct 16

model: Granite switch decision by gabe-l-hart · Pull Request #30676 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30676

0 similar articles

0

3

github.com Oct 15

model: add Muse Spark Open (text, vision and audio) by ServeurpersoCom · Pull Request #30616 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30616

0 similar articles

1

0

github.com Oct 14

cuda, hip: GDN chunked kernel by am17an · Pull Request #29353 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29353

0 similar articles

3

4

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

3

11

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

2

5

github.com Oct 08

ggml-cuda: assign four GDN state columns per warp by SongXiaoXi · Pull Request #30087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30087

0 similar articles

2

7

github.com Oct 06

metal : few-row MMA mat-mul and batched copies for speculative decoding by pratiknarola-t · Pull Request #29869 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29869

0 similar articles

0

3

github.com Aug 20

AVX2: Speed up large batch size prompt processing of IQ models by bartowski1182 · Pull Request #27402 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/27402

0 similar articles

10

27

github.com Aug 19

llama : add --n-cpu-ffn option by John-194 · Pull Request #26622 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26622

0 similar articles

3

43

github.com Jun 05

Qwen3.6 + MTP: Calculated context size is smaller when I use `--spec-draft-type-* q4_0`. is this normal? · ggml-org/llama.cpp · Discussion #24102

github.com/ggml-org/llama.cpp/discussions/24102

0 similar articles

4

38

github.com May 29

Release b9387 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9387

0 similar articles

5

37

github.com Mar 28

ggml: allow prefetching tensor overrides by am17an · Pull Request #21067 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/21067

0 similar articles

7

23

github.com Mar 03

Hybrid model cache: add `--checkpoint-every-nb` by pwilkin · Pull Request #20087 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/20087

0 similar articles

1

8

Last Updated
Total Articles	1

What's the difference between batch-size and ubatch-size? · ggml-org/llama.cpp · Discussion #6328