Commit Graph

811 Commits

Author SHA1 Message Date
Victor Hall b69793623b allow latin-1 encoded txt files 2023-06-11 17:55:29 -04:00
Victor Hall 642b832ca0 remove failure when people do weird custom configs on models 2023-06-10 16:29:03 -04:00
Victor Hall 0e186a2a12 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-06-10 16:27:11 -04:00
Victor Hall 0fba021472
Merge pull request #183 from kelvie/docker-compose
Add docker compose file
2023-06-10 14:34:05 -04:00
Victor Hall 6f64efaaaa
Merge pull request #193 from damian0815/feat_user_defined_batching
User defined batching
2023-06-10 13:08:19 -04:00
Victor Hall b2b02d1438
Merge pull request #192 from AMorporkian/main
Fix spelling error
2023-06-10 12:27:27 -04:00
Victor Hall 5ca2bce2ab
Merge pull request #194 from AMorporkian/dowg-optimizer
Dowg optimizer
2023-06-10 12:13:12 -04:00
SargeZT 2045bcc7c8 i'm a dumbass pass it on 2023-06-09 21:56:05 -05:00
SargeZT f9640d7c51 Re-added coordinate dowg with 0.3.1's release and fix 2023-06-09 21:40:17 -05:00
Damian Stewart 17d9165c36 remove deepcopies 2023-06-08 20:34:51 +02:00
SargeZT e5b08f92b4 Disabled CoordinateDoWG for now because it's a bit unstable with SD training, don't need the troubleshooting requests 2023-06-08 11:36:20 -05:00
SargeZT 4861d96ec2 Added CoordinateDoWG and ScalarDoWG 2023-06-08 10:39:46 -05:00
Damian Stewart a047294676 assert an important precondition 2023-06-08 11:01:16 +02:00
Damian Stewart 4f98f0bcc9 ensure predictable shuffle behaviour and further cleanup 2023-06-08 10:50:51 +02:00
Damian Stewart 1874a38663 cleanup 2023-06-08 10:39:32 +02:00
Damian Stewart b3c5d656e3 refactor for clarity 2023-06-08 10:31:10 +02:00
Damian Stewart 607f1e3ac4 clarify docs 2023-06-08 10:17:08 +02:00
Damian Stewart f37d285272 update docs for batch_size.txt 2023-06-08 10:11:44 +02:00
Victor Hall e255aec653 clarify docker notebook instructions for HF upload 2023-06-07 16:59:44 -04:00
damian 86f80a8776 allow empty default_batch 2023-06-07 18:39:13 +02:00
damian 59fc9891d4 shuffle named batches while respecting and accounting for grad_accum 2023-06-07 18:07:37 +02:00
Damian Stewart a8455b9427 wip first fit decreasing for batch/grad accum shuffling 2023-06-07 13:49:06 +02:00
Damian Stewart ba95b8c6d1 simplify runt handling 2023-06-05 01:04:21 +02:00
Damian Stewart 53d0686086 add a batch_id.txt file to subfolders or a batch_id key to local yaml to force images for that folder to be processed in the same batch 2023-06-05 01:02:27 +02:00
Pat Shanahan e7d199e712
Fix spelling error 2023-06-04 10:13:37 -05:00
Victor Hall 7e09b6dc29
Merge pull request #188 from nawnie/main
Dep update
2023-06-04 00:15:15 -04:00
Victor Hall f2ddc81f63
Merge branch 'main' into main 2023-06-04 00:14:56 -04:00
Victor Hall 9970ccc3fb
Update Train_Colab.ipynb
fix bad variable in colab notebook
2023-06-04 00:10:45 -04:00
Victor Hall 1155a28867 zero terminal fixes 2023-06-03 21:41:56 -04:00
Victor Hall 81b7b00df7 use trained betas for zero terminal snr 2023-06-03 17:17:04 -04:00
Victor Hall d7e12a78b0 add dadapt to win setup 2023-06-03 11:27:38 -04:00
Victor Hall 348f1d7f02 some more optimizer stuff 2023-06-03 11:27:17 -04:00
Victor Hall a96c6e2166 dadapt stuff 2023-06-03 11:26:53 -04:00
Shawn b8015bef2d Dep update 2023-06-03 02:20:40 -05:00
Victor Hall 9ee2effacd add 320 res 2023-06-01 21:19:20 -04:00
Victor Hall 97f1160496 correct image cropping 2023-06-01 21:06:55 -04:00
Victor Hall c0e7c4adf9 errant print 2023-06-01 19:23:43 -04:00
Victor Hall 615fa929e5 errant print 2023-06-01 19:17:43 -04:00
Victor Hall 0e0b546ef7 help debug crop error someone got 2023-06-01 19:11:22 -04:00
Victor Hall 56deb26a59 early work on shuffle_tags.txt and add try around trimming 2023-06-01 16:18:21 -04:00
MFAlex 7dcfa7acbf Speed up preloading by not loading pixel data
PIL lazy loads pixel data, so image size can be accessed without loading the full image.
This commit makes it so only image size and EXIF metadata are fetched from disk, speeding up the preload stage while still supporting transposing images.
2023-05-31 20:48:48 -04:00
Victor Hall 5c98cdee70 update to torch2, xformers 20, bnb 381 2023-05-30 22:15:02 -04:00
Kelvie Wong 249065f127 Add docker compose file
This makes it a lot easier to use locally on docker, and a lot easier to
move files in/out, as well as save notebooks.
2023-05-28 12:42:57 -07:00
Victor Hall 803cadfd53 missed checkin 2023-05-27 01:03:01 -04:00
Victor Hall f59b882376 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-05-26 21:54:12 -04:00
Victor Hall e6a176ea28 new bnb and beta zero terminal snr 2023-05-26 21:54:02 -04:00
Shawn 8fe41e460e xformers 20, and ui update 2023-05-24 02:24:38 -05:00
Damian Stewart 1939cd52b7 apply clip_grad_scale to the unscaled gradients just before stepping the scaler 2023-05-22 23:58:22 -04:00
Victor Hall 562c434113 add banner jpg 2023-05-21 01:10:14 -04:00
Victor Hall 48e31ae58f remove high mem warning for colab 2023-05-20 21:47:00 -04:00