The models/ section currently only has a Qwen3-4B page (src/content/docs/models/qwen3-4b.md and the matching sidebar entry in astro.config.mjs). Qwen3.5-4B is a supported model line in openinfer (openinfer-qwen35-4b crate, --features qwen35-4b) and should have its own page.
What's missing
src/content/docs/models/qwen35-4b.md
- Sidebar entry under the Models group in
astro.config.mjs
Suggested content
Mirror the structure of qwen3-4b.md, but cover the Qwen3.5-4B specifics:
- Build & launch —
cargo run --release --features qwen35-4b -- --model-path models/Qwen3.5-4B
- Build-time Python + Triton AOT — the
qwen35-4b feature is the only build step that needs Python (via openinfer-kernels/tools/triton/gen_triton_aot.py); document OPENINFER_TRITON_PYTHON and the fallback chain (.venv/bin/python → python3 → python)
- Architecture — hybrid layout: 24 linear (SLA) layers + 8 full-attention layers, and how that differs from Qwen3-4B's full attention
- Accuracy gates —
cargo test --release -p openinfer-qwen35-4b --features qwen35-4b --test hf_golden_gate (with OPENINFER_TEST_MODEL_PATH=models/Qwen3.5-4B); note that exact-text JSON baselines are retired and e2e_scheduler is the liveness gate
- Performance — benchmark snapshots when available
Context
- Repo README confirms Qwen3.5-4B is a first-class model line.
AGENTS.md in the main repo has the canonical build/test commands.
Anyone with cycles, feel free to pick this up — happy to review the PR.
The
models/section currently only has a Qwen3-4B page (src/content/docs/models/qwen3-4b.mdand the matching sidebar entry inastro.config.mjs). Qwen3.5-4B is a supported model line in openinfer (openinfer-qwen35-4bcrate,--features qwen35-4b) and should have its own page.What's missing
src/content/docs/models/qwen35-4b.mdastro.config.mjsSuggested content
Mirror the structure of
qwen3-4b.md, but cover the Qwen3.5-4B specifics:cargo run --release --features qwen35-4b -- --model-path models/Qwen3.5-4Bqwen35-4bfeature is the only build step that needs Python (viaopeninfer-kernels/tools/triton/gen_triton_aot.py); documentOPENINFER_TRITON_PYTHONand the fallback chain (.venv/bin/python→python3→python)cargo test --release -p openinfer-qwen35-4b --features qwen35-4b --test hf_golden_gate(withOPENINFER_TEST_MODEL_PATH=models/Qwen3.5-4B); note that exact-text JSON baselines are retired ande2e_scheduleris the liveness gateContext
AGENTS.mdin the main repo has the canonical build/test commands.Anyone with cycles, feel free to pick this up — happy to review the PR.