I encountered this error during the running of both train and evaluation.
Task failed: PydanticSerializationError: Unable to serialize unknown type: <class 'numpy.int64'>
As this error specially doesn't come with traceback, so it's hard to debug and took me few hours. Finally I found that the problem is about weave, after disabling weave, actor_rollout_ref.rollout.trace.backend=weave \, set this line to 'none' instead of 'weave', the problem can be fixed,
I don't know is this only happened to me(maybe environment error) or not, and I also wonder is there any print info during the evaluation, as it takes hours to finish the training and get result(8x L40). I don't know if closing weave will block the print info or not.
I encountered this error during the running of both train and evaluation.
Task failed: PydanticSerializationError: Unable to serialize unknown type: <class 'numpy.int64'>
As this error specially doesn't come with traceback, so it's hard to debug and took me few hours. Finally I found that the problem is about weave, after disabling weave,
actor_rollout_ref.rollout.trace.backend=weave \, set this line to 'none' instead of 'weave', the problem can be fixed,I don't know is this only happened to me(maybe environment error) or not, and I also wonder is there any print info during the evaluation, as it takes hours to finish the training and get result(8x L40). I don't know if closing weave will block the print info or not.