Skip to content

fix: force Qwen2TokenizerFast for qwen2 model types#369

Closed
umran666 wants to merge 1 commit into
p-e-w:masterfrom
umran666:fix/qwen-tokenizer-decoding
Closed

fix: force Qwen2TokenizerFast for qwen2 model types#369
umran666 wants to merge 1 commit into
p-e-w:masterfrom
umran666:fix/qwen-tokenizer-decoding

fix: load Qwen2TokenizerFast for qwen2 model types to prevent charact…

0ae4dbc
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Check and build (Python 3.10)
succeeded Jun 10, 2026 in 53s