Skip to content

[Plugin] [Feature] Supoort MLA q/k norm-quant fusion with SGLang + ATOM plugin for Deepseek#19

Open
qichu-yun wants to merge 1 commit into
plugin_for_sgl_ootfrom
fuse_qknorm_quant
Open

[Plugin] [Feature] Supoort MLA q/k norm-quant fusion with SGLang + ATOM plugin for Deepseek#19
qichu-yun wants to merge 1 commit into
plugin_for_sgl_ootfrom
fuse_qknorm_quant

Conversation

@qichu-yun
Copy link
Copy Markdown
Collaborator

before :
image

after :
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant