RAM-Backed MCP Memory Architecture for Consumer LLM Inference — 900K token context on 16GB VRAM
-
Updated
Mar 27, 2026 - Python
#
rotorquant
Here are 2 public repositories matching this topic...
Rust-native single-binary MLX inference + conversion backend for Apple Silicon
rust metal inference affine quantization mlx kv-cache apple-silicon llm safetensors tiered-cache paroquant turboquant rotorquant gemma4 isoquant qwen3-6 ternary-bonsai mxfp planarquant
-
Updated
Jun 17, 2026 - Rust
Improve this page
Add a description, image, and links to the rotorquant topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the rotorquant topic, visit your repo's landing page and select "manage topics."