Damian Stewart
|
227f56427b
|
write correct epoch number of final save, and add flags to disable grad scaler tweaks, last epoch renaming, ckpt save
|
2023-06-17 19:18:04 +02:00 |
|
Damian Stewart
|
888118ffff
|
correct docs
|
2023-06-17 18:56:25 +02:00 |
|
Damian Stewart
|
eca442f7fb
|
simplify freezing text encoder layers config
|
2023-06-17 18:54:06 +02:00 |
|
Damian Stewart
|
1ab27a9059
|
better check for null manual_data_root
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
dd6b37840d
|
permit empty manual_data_root
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
6c60b76fb6
|
log combined loss if there are >1 val subsets
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
a8c6a59111
|
fix bug with empty samples.txt
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
403f7ddf07
|
fix chunked_shuffle crash with empty list
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
ded73f088f
|
cleanup
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
8885d58efd
|
create bucket if it doesn't exist
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
bd89ad96d2
|
typo
|
2023-06-17 11:04:14 +02:00 |
|
Damian Stewart
|
e4872fdc0c
|
improve shuffle and runt handling for named buckets
|
2023-06-17 11:04:14 +02:00 |
|
Victor Hall
|
dadf881f9a
|
Update Dockerfile
|
2023-06-15 13:03:03 -04:00 |
|
Victor Hall
|
41509dcb3c
|
update linux instal doc
|
2023-06-14 15:53:36 -04:00 |
|
Victor Hall
|
2a29e6d44b
|
Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer
|
2023-06-14 15:04:47 -04:00 |
|
Victor Hall
|
7b6ec89441
|
update install doc for local linux
|
2023-06-14 15:04:35 -04:00 |
|
Victor Hall
|
d1c97241c9
|
Update bug_report.md
|
2023-06-14 13:31:09 -04:00 |
|
Victor Hall
|
01a2920bf3
|
Update error-report.md
|
2023-06-14 13:30:59 -04:00 |
|
Victor Hall
|
5f62bbc198
|
Update Train_JupyterLab.ipynb
|
2023-06-13 11:44:26 -04:00 |
|
Victor Hall
|
2525bb1c5f
|
add colorama for req
|
2023-06-13 00:06:30 -04:00 |
|
Victor Hall
|
a39d36555d
|
Update Train_JupyterLab.ipynb
|
2023-06-12 16:26:13 -04:00 |
|
Victor Hall
|
8713a94ff5
|
Update Train_JupyterLab.ipynb
|
2023-06-12 16:25:22 -04:00 |
|
Victor Hall
|
b69793623b
|
allow latin-1 encoded txt files
|
2023-06-11 17:55:29 -04:00 |
|
Victor Hall
|
642b832ca0
|
remove failure when people do weird custom configs on models
|
2023-06-10 16:29:03 -04:00 |
|
Victor Hall
|
0e186a2a12
|
Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer
|
2023-06-10 16:27:11 -04:00 |
|
Victor Hall
|
0fba021472
|
Merge pull request #183 from kelvie/docker-compose
Add docker compose file
|
2023-06-10 14:34:05 -04:00 |
|
Victor Hall
|
6f64efaaaa
|
Merge pull request #193 from damian0815/feat_user_defined_batching
User defined batching
|
2023-06-10 13:08:19 -04:00 |
|
Victor Hall
|
b2b02d1438
|
Merge pull request #192 from AMorporkian/main
Fix spelling error
|
2023-06-10 12:27:27 -04:00 |
|
Victor Hall
|
5ca2bce2ab
|
Merge pull request #194 from AMorporkian/dowg-optimizer
Dowg optimizer
|
2023-06-10 12:13:12 -04:00 |
|
SargeZT
|
2045bcc7c8
|
i'm a dumbass pass it on
|
2023-06-09 21:56:05 -05:00 |
|
SargeZT
|
f9640d7c51
|
Re-added coordinate dowg with 0.3.1's release and fix
|
2023-06-09 21:40:17 -05:00 |
|
Damian Stewart
|
17d9165c36
|
remove deepcopies
|
2023-06-08 20:34:51 +02:00 |
|
SargeZT
|
e5b08f92b4
|
Disabled CoordinateDoWG for now because it's a bit unstable with SD training, don't need the troubleshooting requests
|
2023-06-08 11:36:20 -05:00 |
|
SargeZT
|
4861d96ec2
|
Added CoordinateDoWG and ScalarDoWG
|
2023-06-08 10:39:46 -05:00 |
|
Damian Stewart
|
a047294676
|
assert an important precondition
|
2023-06-08 11:01:16 +02:00 |
|
Damian Stewart
|
4f98f0bcc9
|
ensure predictable shuffle behaviour and further cleanup
|
2023-06-08 10:50:51 +02:00 |
|
Damian Stewart
|
1874a38663
|
cleanup
|
2023-06-08 10:39:32 +02:00 |
|
Damian Stewart
|
b3c5d656e3
|
refactor for clarity
|
2023-06-08 10:31:10 +02:00 |
|
Damian Stewart
|
607f1e3ac4
|
clarify docs
|
2023-06-08 10:17:08 +02:00 |
|
Damian Stewart
|
f37d285272
|
update docs for batch_size.txt
|
2023-06-08 10:11:44 +02:00 |
|
Victor Hall
|
e255aec653
|
clarify docker notebook instructions for HF upload
|
2023-06-07 16:59:44 -04:00 |
|
damian
|
86f80a8776
|
allow empty default_batch
|
2023-06-07 18:39:13 +02:00 |
|
damian
|
59fc9891d4
|
shuffle named batches while respecting and accounting for grad_accum
|
2023-06-07 18:07:37 +02:00 |
|
Damian Stewart
|
a8455b9427
|
wip first fit decreasing for batch/grad accum shuffling
|
2023-06-07 13:49:06 +02:00 |
|
Damian Stewart
|
ba95b8c6d1
|
simplify runt handling
|
2023-06-05 01:04:21 +02:00 |
|
Damian Stewart
|
53d0686086
|
add a batch_id.txt file to subfolders or a batch_id key to local yaml to force images for that folder to be processed in the same batch
|
2023-06-05 01:02:27 +02:00 |
|
Pat Shanahan
|
e7d199e712
|
Fix spelling error
|
2023-06-04 10:13:37 -05:00 |
|
Victor Hall
|
7e09b6dc29
|
Merge pull request #188 from nawnie/main
Dep update
|
2023-06-04 00:15:15 -04:00 |
|
Victor Hall
|
f2ddc81f63
|
Merge branch 'main' into main
|
2023-06-04 00:14:56 -04:00 |
|
Victor Hall
|
9970ccc3fb
|
Update Train_Colab.ipynb
fix bad variable in colab notebook
|
2023-06-04 00:10:45 -04:00 |