You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Before all, thank you for sharing this wonderful code :)
I'd like to ask why the inner loop learning rate is multiplied by 10 in the function 'update_adamax'.
As an inner loop learning rate, I put the value 1e-6 and observed that the learning rate value(which is defined as clr in the def. update_adamax') is printed to be '1e-5', not '1e-6'.
So would you please let me know why this happens?
Thanks in advance!
The text was updated successfully, but these errors were encountered:
Before all, thank you for sharing this wonderful code :)
I'd like to ask why the inner loop learning rate is multiplied by 10 in the function 'update_adamax'.
As an inner loop learning rate, I put the value 1e-6 and observed that the learning rate value(which is defined as clr in the def. update_adamax') is printed to be '1e-5', not '1e-6'.
So would you please let me know why this happens?
Thanks in advance!
The text was updated successfully, but these errors were encountered: