Since the repository is inactive I don't expect any fixes, but it might be interesting for anyone that experiences weird behaviour when using param groups.
In phase 1, p a loop variable in phase 2 that leaked loop variable is used
https://github.com/lessw2020/Ranger21/blob/main/ranger21%2Franger21.py#L770-L772
This actually not just affects explicit param groups but also default grouping. It essentially turns of regularisation for most of the network.
Fascinating that it was never caught