Can't run quantize on AMD EPYC 7R32 (g5.2xlarge on Amazon)

[sodre]

Solution to issue cannot be found in the documentation.

• I checked the documentation.

Issue

running quantize returns

Illegal instruction

Installed packages

llama.cpp 0.0.1627 cuda120_hbd9d794_0 conda-forge

Environment info

conda version 23.7.4
virtual packages: __archspec=1=x86_64
                  __cuda=12.2=0
                  __glibc=2.26=0
                  __linux=4.14.330=0
                  __unix=0=0