35d52b56e0
added some resolutions, option for val-loss pos-neg, fix wandb
2023-03-25 20:09:06 -04:00
f01a7354f0
remove sort from dataset due to slowdown on large sets, add contribution readme
2023-03-18 22:24:03 -04:00
59f14656fe
make sure undersized image is utf8
2023-03-15 22:14:45 -04:00
ba687de8b4
add pbar back to preloading, remove cruft from testing loss stuff
2023-03-15 12:06:29 -04:00
d1bc94fe3e
cruft left from experiment
2023-03-15 11:23:47 -04:00
9389a90c67
defaulting amp to on now
2023-03-10 21:35:47 -05:00
644c9e6b2a
log to logging.info instead of stdout
2023-03-03 09:52:44 +01:00
15187ae2e2
fix log leaking color
2023-03-02 22:53:59 +01:00
e2fd45737d
overwrite args.seed with the actual seed if -1 is passed (so it appears in tensorboard)
...
also improve logging when unet training is disabled
2023-03-02 22:52:33 +01:00
97a8a49773
don't log separate text encoder LR if it's the same as unet LR
2023-03-02 22:36:32 +01:00
61558be2ae
logging and progress bar improvements
2023-03-02 18:29:28 +01:00
8100e42159
fix issues and improve sample generator
2023-03-02 13:03:50 +01:00
c82664b3f3
add text encoder LR setting to optimizer.json
2023-03-02 00:13:43 +01:00
ba87b0cae1
log how lr was derived
2023-03-01 12:43:32 -05:00
600eaa404d
make sure main lr arg overrides optimizer.json
2023-03-01 12:26:36 -05:00
6c87af7711
doc, fix lr defaulting bug, notdreambooth.md, read multicaption from .txt by line
2023-02-26 19:11:42 -05:00
f4999281ac
Merge pull request #93 from victorchall/lion
...
log lr with rest of optimizer settings to console, put lr into optimi…
2023-02-25 16:24:27 -05:00
b7de987f4c
log lr with rest of optimizer settings to console, put lr into optimizer.json default
2023-02-25 16:23:33 -05:00
e7fc71ffa1
Merge pull request #92 from victorchall/lion
...
fix mem leak on huge data, rework optimizer to separate json, add lio…
2023-02-25 16:20:10 -05:00
a9b0189947
fix mem leak on huge data, rework optimizer to separate json, add lion optimizer
2023-02-25 15:05:22 -05:00
4646af7434
use StableDiffusionPipeline.from_pretrained() to download the model
2023-02-20 22:00:25 +01:00
60702ee040
some validation tweaks and fixes
2023-02-19 10:20:16 +01:00
9365d5a7b2
restore saving on error
2023-02-19 00:21:20 +01:00
80c6883729
default to 2perc zero freq noise
2023-02-18 15:17:08 -05:00
c071230a49
Merge pull request #75 from damian0815/sample_generation_refactor_redo
...
Refactor sample generation and introduce sample_prompts.json
2023-02-18 14:42:55 -05:00
230cab9e27
isolate RNG in sample generation
2023-02-18 20:18:21 +01:00
2f48460691
fix ckpt save if only 1 step per epoch, revert epsilon for amp
2023-02-18 11:23:02 -05:00
648fe20200
better default batch size handling
2023-02-18 15:55:54 +01:00
e97f0816db
Squashed commit of the following:
...
commit 86fa1363852850e87be11e5a277b71435f6a3451
Author: Damian Stewart <d@damianstewart.com>
Date: Sat Feb 18 14:43:57 2023 +0100
cleanup, add back random caption support
commit f9a10842b47b9a5d51d53de8d56cb7089a1eeeb2
Author: Damian Stewart <d@damianstewart.com>
Date: Sat Feb 18 13:52:22 2023 +0100
misc fixes and documentation
commit 46167806892258fef509f14e9d83ceab08725cd6
Author: Damian Stewart <d@damianstewart.com>
Date: Sat Feb 18 12:11:18 2023 +0100
works
commit 390bcdf4d8165315e2f84404c62b410c7b674c84
Author: Damian Stewart <d@damianstewart.com>
Date: Sat Feb 18 10:12:14 2023 +0100
SampleGenerator code in place (untested)
commit 022724fa7a435371081fd489ee7e5dbfc2df37ec
Author: Damian Stewart <d@damianstewart.com>
Date: Sat Feb 18 10:17:05 2023 +0100
cleanup and new approach (untested)
commit 4ac81f0924146a7ac3c46f4a4382e7dceaaac47c
Author: Damian Stewart <d@damianstewart.com>
Date: Fri Jan 27 17:26:12 2023 +0100
fix 'classmethod is not callable' error
commit c875933096464a867a5c3cfbf9592605f201f79e
Author: Damian Stewart <d@damianstewart.com>
Date: Fri Jan 27 17:10:03 2023 +0100
fix prompts log crash
commit 2771d52485191388dfa5b3b8892ed7327d874ed6
Author: Damian Stewart <d@damianstewart.com>
Date: Fri Jan 27 14:38:39 2023 +0100
fix circular import
commit 8452272b02fe64a2345fba067a55e51c52debd98
Author: Damian Stewart <d@damianstewart.com>
Date: Fri Jan 27 14:33:26 2023 +0100
refactor sample generation (untested)
2023-02-18 15:51:50 +01:00
37cf437a5f
zero frequency noise option to improve contrast
2023-02-15 18:53:08 -05:00
e28b23851d
save_ckpts_from_n_epochs arg to skip early saving of ckpts
2023-02-13 12:18:33 -05:00
2353c4c16a
validation doc update
2023-02-08 16:05:19 -05:00
8b13c7ed1f
val...
2023-02-08 13:34:49 -05:00
27b66ab54f
ability to not do val
2023-02-08 13:23:19 -05:00
8a8a4cf3df
make val optional, revert multiply algo
2023-02-08 13:04:12 -05:00
19347bcaa8
make fractional multiplier logic apply per-directory
2023-02-08 14:15:54 +01:00
a7b00e9ef3
fix multiplier logic
2023-02-08 13:46:58 +01:00
4e37200dda
fix multiplier issues with validation and refactor validation logic
2023-02-08 11:28:45 +01:00
00ae25ae60
Merge branch 'main' into feat_cli_args_override_json_file
2023-02-07 20:31:01 -05:00
6f4bfdc557
temporarily disable val, issues
2023-02-07 18:43:16 -05:00
29396ec21b
update EveryDreamValidator for noprompt's changes
2023-02-07 17:46:30 +01:00
e0ca75cc96
remove redundant update_old_args() function
2023-02-07 13:46:19 +01:00
21a64c38f2
move collate_fn to top level to possibly fix windows issue
2023-02-06 19:03:33 +01:00
c270dbf6a8
ensure dataloader workers exit cleanly on ctrl-c
2023-02-06 19:03:33 +01:00
4b5654452c
more workers
2023-02-06 19:03:33 +01:00
86a5004098
better main-thread detection
2023-02-06 19:03:33 +01:00
50a71e63b6
background load images for a 40% performance improvement
2023-02-06 19:03:33 +01:00
927880e1fc
allow cli args to override config values
2023-02-06 08:16:08 +01:00
d99b3b1d9b
Merge pull request #38 from noprompt/push-dlma-into-main
...
Push DLMA into `main`, improvements to `data.resolve`
2023-02-05 08:20:10 -05:00
c8c658d181
Forgot to pass args to write_batch_schedule
2023-01-29 18:28:07 -08:00
Victor Hall