Commit Graph

788 Commits

Author SHA1 Message Date
Victor Hall 81d4d6326f
Update docker-image.yml 2023-06-18 03:03:57 -04:00
Victor Hall e097757ff6
Merge pull request #197 from damian0815/fix_simplify_freezing_text_encoder_layers
simplify freezing text encoder layers config
2023-06-18 00:54:01 -04:00
Victor Hall a916934bb8
Merge branch 'main' into fix_simplify_freezing_text_encoder_layers 2023-06-18 00:53:51 -04:00
Victor Hall 5094dc3d7e
Merge pull request #198 from damian0815/damians_flag_wishes
same flags Damian would like
2023-06-18 00:50:20 -04:00
Victor Hall c4978ac229
Merge pull request #196 from damian0815/fixes_misc
misc small fixes
2023-06-18 00:48:50 -04:00
Damian Stewart 227f56427b write correct epoch number of final save, and add flags to disable grad scaler tweaks, last epoch renaming, ckpt save 2023-06-17 19:18:04 +02:00
Damian Stewart 888118ffff correct docs 2023-06-17 18:56:25 +02:00
Damian Stewart eca442f7fb simplify freezing text encoder layers config 2023-06-17 18:54:06 +02:00
Damian Stewart 1ab27a9059 better check for null manual_data_root 2023-06-17 11:04:14 +02:00
Damian Stewart dd6b37840d permit empty manual_data_root 2023-06-17 11:04:14 +02:00
Damian Stewart 6c60b76fb6 log combined loss if there are >1 val subsets 2023-06-17 11:04:14 +02:00
Damian Stewart a8c6a59111 fix bug with empty samples.txt 2023-06-17 11:04:14 +02:00
Damian Stewart 403f7ddf07 fix chunked_shuffle crash with empty list 2023-06-17 11:04:14 +02:00
Damian Stewart ded73f088f cleanup 2023-06-17 11:04:14 +02:00
Damian Stewart 8885d58efd create bucket if it doesn't exist 2023-06-17 11:04:14 +02:00
Damian Stewart bd89ad96d2 typo 2023-06-17 11:04:14 +02:00
Damian Stewart e4872fdc0c improve shuffle and runt handling for named buckets 2023-06-17 11:04:14 +02:00
Victor Hall dadf881f9a
Update Dockerfile 2023-06-15 13:03:03 -04:00
Victor Hall 41509dcb3c update linux instal doc 2023-06-14 15:53:36 -04:00
Victor Hall 2a29e6d44b Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-06-14 15:04:47 -04:00
Victor Hall 7b6ec89441 update install doc for local linux 2023-06-14 15:04:35 -04:00
Victor Hall d1c97241c9
Update bug_report.md 2023-06-14 13:31:09 -04:00
Victor Hall 01a2920bf3
Update error-report.md 2023-06-14 13:30:59 -04:00
Victor Hall 5f62bbc198
Update Train_JupyterLab.ipynb 2023-06-13 11:44:26 -04:00
Victor Hall 2525bb1c5f add colorama for req 2023-06-13 00:06:30 -04:00
Victor Hall a39d36555d
Update Train_JupyterLab.ipynb 2023-06-12 16:26:13 -04:00
Victor Hall 8713a94ff5
Update Train_JupyterLab.ipynb 2023-06-12 16:25:22 -04:00
Victor Hall b69793623b allow latin-1 encoded txt files 2023-06-11 17:55:29 -04:00
Victor Hall 642b832ca0 remove failure when people do weird custom configs on models 2023-06-10 16:29:03 -04:00
Victor Hall 0e186a2a12 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-06-10 16:27:11 -04:00
Victor Hall 0fba021472
Merge pull request #183 from kelvie/docker-compose
Add docker compose file
2023-06-10 14:34:05 -04:00
Victor Hall 6f64efaaaa
Merge pull request #193 from damian0815/feat_user_defined_batching
User defined batching
2023-06-10 13:08:19 -04:00
Victor Hall b2b02d1438
Merge pull request #192 from AMorporkian/main
Fix spelling error
2023-06-10 12:27:27 -04:00
Victor Hall 5ca2bce2ab
Merge pull request #194 from AMorporkian/dowg-optimizer
Dowg optimizer
2023-06-10 12:13:12 -04:00
SargeZT 2045bcc7c8 i'm a dumbass pass it on 2023-06-09 21:56:05 -05:00
SargeZT f9640d7c51 Re-added coordinate dowg with 0.3.1's release and fix 2023-06-09 21:40:17 -05:00
Damian Stewart 17d9165c36 remove deepcopies 2023-06-08 20:34:51 +02:00
SargeZT e5b08f92b4 Disabled CoordinateDoWG for now because it's a bit unstable with SD training, don't need the troubleshooting requests 2023-06-08 11:36:20 -05:00
SargeZT 4861d96ec2 Added CoordinateDoWG and ScalarDoWG 2023-06-08 10:39:46 -05:00
Damian Stewart a047294676 assert an important precondition 2023-06-08 11:01:16 +02:00
Damian Stewart 4f98f0bcc9 ensure predictable shuffle behaviour and further cleanup 2023-06-08 10:50:51 +02:00
Damian Stewart 1874a38663 cleanup 2023-06-08 10:39:32 +02:00
Damian Stewart b3c5d656e3 refactor for clarity 2023-06-08 10:31:10 +02:00
Damian Stewart 607f1e3ac4 clarify docs 2023-06-08 10:17:08 +02:00
Damian Stewart f37d285272 update docs for batch_size.txt 2023-06-08 10:11:44 +02:00
Victor Hall e255aec653 clarify docker notebook instructions for HF upload 2023-06-07 16:59:44 -04:00
damian 86f80a8776 allow empty default_batch 2023-06-07 18:39:13 +02:00
damian 59fc9891d4 shuffle named batches while respecting and accounting for grad_accum 2023-06-07 18:07:37 +02:00
Damian Stewart a8455b9427 wip first fit decreasing for batch/grad accum shuffling 2023-06-07 13:49:06 +02:00
Damian Stewart ba95b8c6d1 simplify runt handling 2023-06-05 01:04:21 +02:00