Attempted dense-to-MoE conversion of Qwen 3.5 9B (DeltaNet hybrid) using CMoE and D2DMoE. Documents why post-hoc MoEfication fails on SwiGLU models without extensive sparsification. Negative result.
-
Updated
May 28, 2026
Attempted dense-to-MoE conversion of Qwen 3.5 9B (DeltaNet hybrid) using CMoE and D2DMoE. Documents why post-hoc MoEfication fails on SwiGLU models without extensive sparsification. Negative result.
Add a description, image, and links to the moefication topic page so that developers can more easily learn about it.
To associate your repository with the moefication topic, visit your repo's landing page and select "manage topics."