Skip to content

Releases: oobabooga/llama-cpp-python-cuBLAS-wheels

wheels

13 Dec 17:34

Choose a tag to compare

Add -DLLAMA_CUDA_FORCE_MMQ=ON option

textgen-webui

13 Dec 17:34

Choose a tag to compare

rocm

13 Dec 17:31

Choose a tag to compare

Add -DLLAMA_CUDA_FORCE_MMQ=ON option

metal

19 Dec 14:26

Choose a tag to compare

Add -DLLAMA_CUDA_FORCE_MMQ=ON option

cpu

13 Dec 17:24

Choose a tag to compare

cpu
Add -DLLAMA_CUDA_FORCE_MMQ=ON option

basic

13 Dec 17:34

Choose a tag to compare

Add -DLLAMA_CUDA_FORCE_MMQ=ON option

AVX512

13 Dec 17:34

Choose a tag to compare

Add -DLLAMA_CUDA_FORCE_MMQ=ON option

AVX

13 Dec 17:34

Choose a tag to compare

AVX
Add -DLLAMA_CUDA_FORCE_MMQ=ON option