Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training(arxiv.org)7 points by alechammond 3 years ago | 0 commentsNo comments yet