Skip to content

fix(server): disable GGML_CUDA_GRAPHS to avoid ggml CUDA graph key collision crash#460

Open
zatchbell1311-wq wants to merge 6 commits into
pie-project:mainfrom
zatchbell1311-wq:fix/cuda-graph-key-collision
Open

fix(server): disable GGML_CUDA_GRAPHS to avoid ggml CUDA graph key collision crash#460
zatchbell1311-wq wants to merge 6 commits into
pie-project:mainfrom
zatchbell1311-wq:fix/cuda-graph-key-collision