GitHub - uaysk/vllm-pascal: vLLM fork for pascal gpu:

vLLM fork for pascal gpu. Contribute to uaysk/vllm-pascal development by creating an account on GitHub.

Story Details

Last Updated
Total Articles	1

Main Topics

Llama (language model)

#llama-language-model

large language model by Meta AI

Fork (software development)

#fork-software-development

new program, and line of software development, derived from an existing one

Graphics processing unit

#graphics-processing-unit-643f5ad2632e9

specialized electronic circuit; graphics accelerator

Similar to This

github.com 22h

GitHub - eagle-hq/EAGLE-4: Official Inference Code of EAGLE-4: Official Inference Code of EAGLE-4. Contribute to eagle-hq/EAGLE-4 development by creating an ...

github.com/eagle-hq/EAGLE-4

0 similar articles

github.com Oct 19

GitHub - AlexBrandes/cmp170hx-qwen38-flash-next: Qwen3.8-Flash-Next (W4A16) on 2x NVIDIA CMP 170HX with vLLM pipeline parallel: 226 tok/s single-user ...

github.com/AlexBrandes/cmp170hx-qwen38-flash-next

0 similar articles

github.com Oct 13

GitHub - ErikBPF/pqnld: Contribute to ErikBPF/pqnld development by creating an account on GitHub.

github.com/ErikBPF/pqnld

0 similar articles

github.com Oct 10

[Feat] Structured decisions endpoint (`/v1/systemone`) by mmastrac · Pull Request #59299 · vllm-project/vllm

github.com/vllm-project/vllm/pull/59299

0 similar articles

github.com Oct 08

GitHub - ZC502/clim-agent-guard: A small deterministic execution-integrity layer for stateful agents.

github.com/ZC502/clim-agent-guard

0 similar articles

github.com Sep 15

GitHub - majidkorai/Go-LLM: Contribute to majidkorai/Go-LLM development by creating an account on GitHub.

github.com/majidkorai/Go-LLM

0 similar articles

github.com Aug 30

Issue · vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs - Issue · vllm-project/vllm

github.com/vllm-project/vllm

0 similar articles

github.com Aug 24

GitHub - andysalerno/r9700-serving: dockerfiles, compose files, benchmarks for 2x R9700 serving

github.com/andysalerno/r9700-serving

0 similar articles

github.com Aug 15

GitHub - syv-ai/qwen38-27b-rtx3090: Qwen3.8-27B on a single RTX 3090 with vLLM: ~1,000 tok/s at 64 concurrent (int8 tensor-core GEMMs, fp16 DeltaNet state) ...

github.com/syv-ai/qwen38-27b-rtx3090

0 similar articles

github.com Jun 08

club-3090/models/qwen3.6-27b/vllm/compose/dual/fp8/mtp.yml at master · noonghunna/club-3090

github.com/noonghunna/club-3090/blob/master/models/qwen3.6-27b/vllm/compose/dual/fp8/mtp.yml

0 similar articles

github.com Apr 27

GitHub - tedivm/qwen36-27b-docker: vLLM Docker Container for Qwen36 27b: vLLM Docker Container for Qwen36 27b. Contribute to tedivm/qwen36-27b-docker development ...

github.com/tedivm/qwen36-27b-docker

0 similar articles

github.com Apr 14

GitHub - jungledesh/profile: A physics-grounded, cost-aware optimizer for vLLM.: A physics-grounded, cost-aware optimizer for vLLM. - jungledesh/profile

github.com/jungledesh/profile

0 similar articles

github.com Apr 06

GitHub - ai-infos/vllm-gfx906-mobydick: A high-throughput and memory-efficient inference and serving engine for LLMs - Optimized for AMD gfx906 GPUs, e.g ...

github.com/ai-infos/vllm-gfx906-mobydick

0 similar articles

github.com Mar 29

GitHub - namake-taro/vllm-custom: Contribute to namake-taro/vllm-custom development by creating an account on GitHub.

github.com/namake-taro/vllm-custom

0 similar articles

github.com Mar 27

GitHub - soy-tuber/nemotron: Local multimodal LLM gateway unifying NVIDIA Nemotron models on a single GPU

github.com/soy-tuber/nemotron

0 similar articles

github.com Mar 22

GitHub - ian-hailey/vllm-docker-Qwen3-5-122B-A10B-NVFP4: Docker container config for launching Qwen3.5-122B-A10B-NVFP4 with vLLM

github.com/ian-hailey/vllm-docker-Qwen3-5-122B-A10B-NVFP4

0 similar articles

github.com Mar 20

[Bug]: The hit rate of prefix caching in Qwen3.5 35BA3B is very low, always less than 0.1% · Issue #36493 · vllm-project/vllm

github.com/vllm-project/vllm/issues/36493

0 similar articles

github.com Feb 13

GitHub - fabriziopfannl/autovram: GPU Auto-Optimizer: fastest stable batch/precision config for ML scripts & vLLM

github.com/fabriziopfannl/autovram

0 similar articles