Hello.
I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The whole procedure is below. Unfortunately it does not work with a nvidia driver greater than 525 or 535 ?
marietto @ marietto:~ $ git clone h t t p s : / / g i t h u b . c o m / outpaddling /freebsd-ports-wip . git
marietto@marietto:~ $ cd /usr/ports/wip
marietto@marietto:~ $ pkg install auto-admin
marietto@marietto:~ $ auto-ports-wip-checkout
marietto@marietto:/usr/ports/wip $ cd linux-miniconda-installer
marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ ls
Makefile distinfo pkg-descr work
marietto@marietto:/usr/ports/wip/linux-miniconda-installer $ make clean
===> Cleaning for linux-miniconda-installer-0.1.0.3
===> /usr/ports/wip/linux-miniconda-installer/work not writable, skipping
marietto @ marietto:/usr/ports/wip/linux-miniconda-installer $ su
Password:
root @ marietto:/usr/ports/wip/linux-miniconda-installer # make clean
===> Cleaning for linux-miniconda-installer-0.1.0.3
root @ marietto:/usr/ports/wip/linux-miniconda-installer # make
===> License BSD2CLAUSE accepted by the user
===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/sbin/pkg - found
===> Fetching all distfiles required by linux-miniconda-installer-0.1.0.3 for building
===> Extracting for linux-miniconda-installer-0.1.0.3
=> SHA256 Checksum OK for outpaddling-miniconda-installer-0.1.0-3-g0aa48c6_GH0.tar.gz.
===> Patching for linux-miniconda-installer-0.1.0.3
===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/bin/python3.11 - found
===> Configuring for linux-miniconda-installer-0.1.0.3
===> Staging for linux-miniconda-installer-0.1.0.3
===> linux-miniconda-installer-0.1.0.3 depends on package: auto-admin>=0.8.0 - found
===> linux-miniconda-installer-0.1.0.3 depends on package: linux_base-rl9>=9.2 - found
===> linux-miniconda-installer-0.1.0.3 depends on file: /usr/local/bin/python3.11 - found
===> Generating temporary packing list
install -m 555 /usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/miniconda-installer /usr/ports/wip/linux-miniconda-installer/work/miniconda-installer-0.1.0-3-g0aa48c6/conda-shell /usr/ports/wip/linux-miniconda-installer/work/stage/usr/local/bin
====> Compressing man pages (compress-man)
root @ marietto:/usr/ports/wip/linux-miniconda-installer # make install
===> Installing for linux-miniconda-installer-0.1.0.3
===> Checking if linux-miniconda-installer is already installed
===> Registering installation for linux-miniconda-installer-0.1.0.3
Installing linux-miniconda-installer-0.1.0.3...
marietto @ marietto:/$ nvidia-smi
Thu May 8 00:51:53 2025
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 565.77 Driver Version: 565.77 CUDA Version: 12.7 |
|-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce GTX 1060 3GB Off | 00000000:01:00.0 On | N/A |
| 53% 32C P8 7W / 120W | 339MiB / 3072MiB | 8% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
| 1 NVIDIA GeForce RTX 2080 Ti Off | 00000000:02:00.0 Off | N/A |
| 31% 35C P8 21W / 250W | 2MiB / 11264MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 4116 G /usr/local/libexec/Xorg 190MiB |
| 0 N/A N/A 4154 G xfwm4 2MiB |
| 0 N/A N/A 4234 G /usr/local/lib/firefox/firefox 142MiB |
+-----------------------------------------------------------------------------------------+
# pkg install linux-rl9-devtools linux-rl9-libglvnd
# cd /home/marietto
# conda-shell
# source conda.sh
# conda activate
# conda create --name pytorch python=3.12
# conda activate pytorch
# pip install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu128
# LD_PRELOAD="/home/marietto/.config/gpu/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())'
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:181: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().
Did you run some cuda functions before calling NumCudaDevices() that might have already set an error?
Error 304: OS call failed or operation not supported on this OS (Triggered internally at /pytorch/c10/cuda/CUDAFunctions.cpp:109.) return torch._C._cuda_getDeviceCount() > 0
False
$ pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu127
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cu127
Requirement already satisfied: torch in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (4.12.2)
Requirement already satisfied: setuptools in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.3)
Requirement already satisfied: networkx in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.4.2)
Requirement already satisfied: jinja2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.1.4)
Requirement already satisfied: fsspec in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from jinja2->torch) (2.1.5)
# conda install pytorch torchvision torchaudio pytorch-cuda=12.4 -c pytorch -c nvidia
# git clone https://github.com/comfyanonymous/ComfyUI.git
(pytorch) I have no name!@marietto:/usr/home/marietto$ cd ComfyUI
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ pip install -r requirements.txt
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ python -c 'import torch; print(torch.cuda.is_available())'
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129: UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount().
Did you run some cuda functions before calling NumCudaDevices() that might have already set an error?
Error 304: OS call failed or operation not supported on this OS (Triggered internally at /opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.) return torch._C._cuda_getDeviceCount() > 0
False
(pytorch) I have no name!@marietto:/usr/home/marietto/ComfyUI$ LD_PRELOAD="${HOME}/.config/gpu/dummy-uvm.so" python -c 'import torch; print(torch.cuda.is_available())'
/home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages/torch/cuda/__init__.py:129:
UserWarning: CUDA initialization: Unexpected error from cudaGetDeviceCount(). Did you run some cuda functions before calling NumCudaDevices() that might have already set an error?
Error 304: OS call failed or operation not supported on this OS (Triggered internally at /opt/conda/conda-bld/pytorch_1729647378361/work/c10/cuda/CUDAFunctions.cpp:108.)
return torch._C._cuda_getDeviceCount() > 0
False
(pytorch) I have no name!@marietto:/usr/home/marietto$ conda install pytorch torchvision torchaudio pytorch-cuda=12.7 -c pytorch -c nvidia
Collecting package metadata (current_repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
Collecting package metadata (repodata.json): done
Solving environment: failed with initial frozen solve. Retrying with flexible solve.
PackagesNotFoundError: The following packages are not available from current channels:
- pytorch-cuda=12.7
In this thread you suggested to use cu126 :
https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2
so :
(pytorch) I have no name! @ marietto:/usr/home/marietto$ pip3 install --pre torch torchvision torchaudio --index-url h t t p s : / / d o w n l o a d . p y to r c h . o r g /w h l / nightly/ cu126
Looking in indexes: https://download.pytorch.org/whl/nightly/cu126
Requirement already satisfied: torch in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.8.0.dev20250507+cu128)
Requirement already satisfied: torchvision in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (0.22.0.dev20250507+cu128)
Requirement already satisfied: torchaudio in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (2.6.0.dev20250507+cu128)
Requirement already satisfied: filelock in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.16.1)
Requirement already satisfied: typing-extensions>=4.10.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (4.12.2)
Requirement already satisfied: setuptools in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (78.1.1)
Requirement already satisfied: sympy>=1.13.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.3)
Requirement already satisfied: networkx in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.4.2)
Requirement already satisfied: jinja2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.1.4)
Requirement already satisfied: fsspec in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2024.10.0)
Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61)
Requirement already satisfied: nvidia-cuda-runtime-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57)
Requirement already satisfied: nvidia-cuda-cupti-cu12==12.8.57 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.57)
Requirement already satisfied: nvidia-cudnn-cu12==9.8.0.87 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (9.8.0.87)
Requirement already satisfied: nvidia-cublas-cu12==12.8.3.14 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.3.14)
Requirement already satisfied: nvidia-cufft-cu12==11.3.3.41 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.3.3.41)
Requirement already satisfied: nvidia-curand-cu12==10.3.9.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (10.3.9.55)
Requirement already satisfied: nvidia-cusolver-cu12==11.7.2.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (11.7.2.55)
Requirement already satisfied: nvidia-cusparse-cu12==12.5.7.53 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.5.7.53)
Requirement already satisfied: nvidia-cusparselt-cu12==0.6.3 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (0.6.3)
Requirement already satisfied: nvidia-nccl-cu12==2.26.2 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (2.26.2)
Requirement already satisfied: nvidia-nvtx-cu12==12.8.55 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.55)
Requirement already satisfied: nvidia-nvjitlink-cu12==12.8.61 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (12.8.61)
Requirement already satisfied: nvidia-cufile-cu12==1.13.0.11 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (1.13.0.11)
Requirement already satisfied: pytorch-triton==3.3.0+git96316ce5 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torch) (3.3.0+git96316ce5)
Requirement already satisfied: numpy in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (2.1.2)
Requirement already satisfied: pillow!=8.3.*,>=5.3.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from torchvision) (11.0.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from sympy>=1.13.3->torch) (1.3.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/marietto/miniconda3/envs/pytorch/lib/python3.12/site-packages (from jinja2->torch) (2.1.5)
no way…the only way to make work Stable diffusion is to use the nvidia driver and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113” and it works like a charme :
(pytorch) I have no name! @ marietto:/usr/home/marietto$ LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.is_available())'
True
(pytorch) I have no name!@marietto:/usr/home/marietto$ LD_PRELOAD="/compat/dummy-uvm.so" python3 -c 'import torch; print(torch.cuda.get_device_name(0))'
NVIDIA GeForce RTX 2080 Ti
Hello.
I’m trying to run PyTorch and Stable Diffusion and / or ComfyUI on FreeBSD. The whole procedure is below. Unfortunately it does not work with a nvidia driver greater than 525 or 535 ?
In this thread you suggested to use cu126 :
https://discuss.pytorch.org/t/pytorch-vrsion-for-cuda-12-7/214153/2
so :
no way…the only way to make work Stable diffusion is to use the nvidia driver and the linux-nvidia-libs vers. 525.78.01 and “torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113” and it works like a charme :