A bug when executing the the code

[mingyin1]

When I was executing the command

python scripts/general_model_inference.py
--model_name meta-llama/Llama-2-7b
--model_dir "outputs"
--output_file "outputs/Qwen2.5-7B-Instruct.json"
--nshots 8
--prompt_type cot-nshot
--specify_your_gpus 0

There's a bug

File "/home/my206/anaconda3/envs/gg/lib/python3.9/site-packages/vllm/transformers_utils/config.py", line 263, in get_config
raise ValueError(f"No supported config format found in {model}.")

I searched online but haven't found helpful solutions.

Thanks for your help!

[qtli]

Hi, sorry for the late reply.

You need to specify the exact path to your inference model for the model_dir argument.