GitHub - heterodoxin/AbliteratedOutTheBox: llama.cpp fork that abliterates at inference

github.com/heterodoxin/AbliteratedOutTheBox

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Fork (software development)

#fork-software-development

new program, and line of software development, derived from an existing one

Gate

#gate

point of entry to a space enclosed by building, wall or fence

Similar to This

github.com 10h

qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30965

0 similar articles

github.com Oct 22

llama : add adaptive single-graph MoE offload by pwilkin · Pull Request #30971 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30971

0 similar articles

github.com Oct 21

llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30640

0 similar articles

github.com Oct 22

webgpu : add Q2_0 support by teddygood · Pull Request #30914 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30914

0 similar articles

github.com Oct 21

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30928

0 similar articles

github.com Oct 18

GitHub - achyudh/llama.cpp: LLM inference in C/C++: LLM inference in C/C++. Contribute to achyudh/llama.cpp development by creating an account on GitHub.

github.com/achyudh/llama.cpp

0 similar articles

159

github.com Oct 17

CUDA: faster MMVQ for low-bit types by am17an · Pull Request #30517 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30517

0 similar articles

github.com Oct 16

cpu : reduce AVX2 tiled accumulators together by trivalik · Pull Request #30296 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30296

0 similar articles

github.com Oct 14

common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/30459

0 similar articles

github.com Oct 10

[Model] Support MiniCPM-V 4.7 by tc-mb · Pull Request #29416 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/29416

0 similar articles

github.com Jul 27

model: add Kimi-K3 text model by pwilkin · Pull Request #26185 · ggml-org/llama.cpp

github.com/ggml-org/llama.cpp/pull/26185

0 similar articles

github.com Jul 13

Release b9978 · ggml-org/llama.cpp: LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.

github.com/ggml-org/llama.cpp/releases/tag/b9978

3 similar articles

github.com Apr 02

GitHub - philtomson/llama.cpp: LLM inference in C/C++ (fork of PrismML fork that enables CPU (incl AVX2 and AVX512) and ROCm for AMD GPUs

github.com/philtomson/llama.cpp

0 similar articles

github.com Apr 01

GitHub - jimliddle/turboquant-amd-vulkan: A TurboQuant implementation with Llama.cpp for AMD with Vulkan runtime

github.com/jimliddle/turboquant-amd-vulkan

0 similar articles