Skip to content
#

ampere

Here are 29 public repositories matching this topic...

Runtime patches for vLLM — Qwen3.6 (27B int4 / 35B-A3B FP8) on consumer Ampere. 50+ patches: TurboQuant KV, MTP / DFlash / ngram spec-decode, FULL cudagraph, 256K-320K context. v7.64: P67 non-pow-2 GQA, Cliff 1 fix, 6 docs (FAQ/HARDWARE/CONFIGS/CLIFFS), Genesis Compat Layer.

  • Updated May 1, 2026
  • Python

First public benchmark of llama.cpp speculative decoding on Qwen3.6-35B-A3B with a single RTX 3090 (post PR #19493 merge, 2026-04-19). 19 configurations covering ngram-cache, ngram-mod, and classic draft with vocab-matched Qwen3.5-0.8B. Finding: no variant achieves net speedup on Ampere + A3B MoE. Raw JSON, plots, full reproducibility.

  • Updated Apr 26, 2026
  • Python

Improve this page

Add a description, image, and links to the ampere topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the ampere topic, visit your repo's landing page and select "manage topics."

Learn more