You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Goal: 1) no arbitrary flags and incorrect parameters, 2) chat templates and parser names are up-to-date with the vllm codebase, 3) deprecated fields are replaced with current equivalents.
Typo in --limit-mm-per-prompt flag: The multimodal prompt limit flag used a space instead of a comma to separate modalities, causing a parse error: Value image=0 cannot be converted. Solved by vllm-project/recipes#310 (@GaurangTandon).
Incorrect reasoning and tool parser names: The recipe specified wrong parser names for the Gemma4 reasoning and tool parsers, inconsistent with the actual parser code. Solved by vllm-project/recipes#316 (@whynotkimhari).
Recipe file: Google/Gemma4.md
Goal: 1) no arbitrary flags and incorrect parameters, 2) chat templates and parser names are up-to-date with the vllm codebase, 3) deprecated fields are replaced with current equivalents.
Action items
reasoning_contentfield: The recipe used an old chat template and the deprecatedreasoning_contentfield for reasoning/tool calling. Updated to the new chat template merged in [Tool]adjust_requestto reasoning parser, and Gemma4 fixes vllm#39027 and replaced with the currentreasoningfield. Solved by vllm-project/recipes#322 (@bbrowning).--limit-mm-per-promptflag: The multimodal prompt limit flag used a space instead of a comma to separate modalities, causing a parse error:Value image=0 cannot be converted. Solved by vllm-project/recipes#310 (@GaurangTandon).