NAZ LLM EVALS + row_log.py (llama as a judge script) + recent_utils_py (most up to date)

[nazcol]

No description provided.

[nazcol]

serve request that is erroring below:

vllm serve meta-llama/Meta-Llama-3-8B-Instruct
--gpu-memory-utilization 0.95
--max-model-len 2048
--port 8001
--tensor-parallel-size 1
--max-num-seqs 32

[lisadunlap]

looks good! Mostly minor things and making sure we are updating files instead of making new ones

[lisadunlap]

how does this differ from the get_differences.py file? If we are modifying that file let's name it the same thing so we don't muddy the repo

[nazcol]

they actually are doing the same thing just checked now, I can change the name of mine nevertheless though

[lisadunlap]

can we move these to a folder

[lisadunlap]

can we instead update the existing utils_llm file

[lisadunlap]

remove