GPU memory usage for training and inference

[XinZeng-ai]

Hi, thanks for your great work!

Could you please share the approximate GPU memory usage for training and inference of SpatialReasoner?
It would be very helpful to know the GPU type you used and the typical VRAM consumption during both training and evaluation.

Thanks in advance!

[johnson111788]

Hi, sorry for the late reply. I just saw this issue.

We were using 4xH100 80GB GPUs with BS=6 and BS=12 for SFT and RL, respectively. Feel free to let me know if there are issues during training or inference.

Best,
Yu-Cheng