Update OPTIMIZER.md

2023-07-23 02:16:26 -04:00 · 2023-07-23 02:16:26 -04:00 · ab563a50e0
parent a87b4ff92e
commit ab563a50e0
1 changed files with 1 additions and 1 deletions
--- a/doc/OPTIMIZER.md
+++ b/doc/OPTIMIZER.md
@ -38,7 +38,7 @@ Lucidrains' [implementation](https://github.com/lucidrains/lion-pytorch) of the

 Recommended settings for lion based on the paper are as follows:

-    "optimizer": "adamw8bit",
+    "optimizer": "lion",
        "lr": 1e-7,
        "lr_scheduler": "constant",
        "betas": [0.9, 0.999],