Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke)

Google says 3e-4 is the best lr for Adam (misinterpreted Karpathy's joke)(google.com)

1 points by vukadinovic 4 years ago | 1 comment

Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".

vukadinovic 4 years ago |

Google misinterpreted Karpathy's (joke) tweet, and by searching " what is the best learning rate for adam optimizer " says that " 3e-4 is the best hands down ".