Building our own Ruby (libruby*.dylib) just for Gosu is hopeless. I don't have the bandwidth to fix all the issues that pop up. Smarter people have already solved this:
https://github.com/Homebrew/homebrew-portable-ruby/releases
It should be possible to replace all the RVM trickery with just downloading and lipo'ing their Ruby versions.