Possible error inside the training class

[will0hlep]

Should "if ( _ / update_epochs == 0):" be "if ( _ % update_epochs == 0):"?

[GangSuUGA]

Thanks for the question!

Below is my understanding:
if ( _ / update_epochs == 0) means only when the training epochs is equal to the update_epochs, the target model will copy the main model.
if ( _ % update_epochs == 0) means the target model will copy the main model every epoch, regardless of the update_epochs parameter.

We would like to set the target model updated slowly or with a delay.

[will0hlep]

To make what I'm saying clearer I'm going to replace the counter "_" with "x" and the variable "update_epochs" with "y".

Actually, using if x/y == 0:, is the same as using if x == 0: as x/y=0 only when x=0. This means that when each time the "run" function is called, the target network is updated only on the first loop. With this version of the code, the "update_epochs" variable has no effect at all.

Whereas using if x%y == 0 would mean that the target network is updated every time x is a multiple of y. Setting y ("update_epochs") to 1 would mean the target network was updated after every training epoch, but setting y ("update_epochs") to say 2 would mean the target network was updated after every second training epoch, ect.

[GangSuUGA]

To make what I'm saying clearer I'm going to replace the counter "_" with "x" and the variable "update_epochs" with "y".

Actually, using if x/y == 0:, is the same as using if x == 0: as x/y=0 only when x=0. This means that when each time the "run" function is called, the target network is updated only on the first loop. With this version of the code, the "update_epochs" variable has no effect at all.

Whereas using if x%y == 0 would mean that the target network is updated every time x is a multiple of y. Setting y ("update_epochs") to 1 would mean the target network was updated after every training epoch, but setting y ("update_epochs") to say 2 would mean the target network was updated after every second training epoch, ect.

[GangSuUGA]

You are right. Thanks very much for your issues!