Commit Graph

49 Commits

Author SHA1 Message Date
Augusto de la Torre cdafa2dc43 Avoid unnecessary iteration over files in folder 2023-03-21 12:09:52 +01:00
Augusto de la Torre 0716c40ab6 Add support for enhanced dataset configuration
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00
Damian Stewart 29c93eca03 if progress bars are disabled, log a short message instead 2023-03-03 10:50:48 +01:00
Damian Stewart c4d37862ba document new sample generator params 2023-03-02 23:12:47 +01:00
Damian Stewart fe0083877f add aspect_ratio arg to sample generation 2023-03-02 22:16:21 +01:00
Damian Stewart 52c722714c Merge branch 'feat_text_encoder_LR' of github.com:damian0815/EveryDream2trainer into feat_text_encoder_LR 2023-03-02 20:02:38 +01:00
damian 61558be2ae logging and progress bar improvements 2023-03-02 18:29:28 +01:00
Damian Stewart 17c61db5ca wip aspect ratio samples 2023-03-02 14:50:17 +01:00
Damian Stewart 8100e42159 fix issues and improve sample generator 2023-03-02 13:03:50 +01:00
nawnie e9ba16f544
sample updates
add more samplers
2023-02-27 18:14:23 -06:00
Victor Hall e7fc71ffa1
Merge pull request #92 from victorchall/lion
fix mem leak on huge data, rework optimizer to separate json, add lio…
2023-02-25 16:20:10 -05:00
Victor Hall a9b0189947 fix mem leak on huge data, rework optimizer to separate json, add lion optimizer 2023-02-25 15:05:22 -05:00
Victor Hall 30c7b2f96d
Merge pull request #83 from damian0815/fix-huggingface-download-safetensors-models
use StableDiffusionPipeline.from_pretrained() to download HF models
2023-02-21 11:37:23 -05:00
Damian Stewart 4646af7434 use StableDiffusionPipeline.from_pretrained() to download the model 2023-02-20 22:00:25 +01:00
Damian Stewart be8cdf8af8 actually use validation seed 😭 also fix log of sample negative prompt 2023-02-20 21:58:46 +01:00
Damian Stewart 60702ee040 some validation tweaks and fixes 2023-02-19 10:20:16 +01:00
Victor Hall c071230a49
Merge pull request #75 from damian0815/sample_generation_refactor_redo
Refactor sample generation and introduce sample_prompts.json
2023-02-18 14:42:55 -05:00
Damian Stewart 230cab9e27 isolate RNG in sample generation 2023-02-18 20:18:21 +01:00
Damian Stewart 759623142a more cleanly fall back to random captions 2023-02-18 19:28:08 +01:00
Damian Stewart 648fe20200 better default batch size handling 2023-02-18 15:55:54 +01:00
Damian Stewart e97f0816db Squashed commit of the following:
commit 86fa1363852850e87be11e5a277b71435f6a3451
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 14:43:57 2023 +0100

    cleanup, add back random caption support

commit f9a10842b47b9a5d51d53de8d56cb7089a1eeeb2
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 13:52:22 2023 +0100

    misc fixes and documentation

commit 46167806892258fef509f14e9d83ceab08725cd6
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 12:11:18 2023 +0100

    works

commit 390bcdf4d8165315e2f84404c62b410c7b674c84
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 10:12:14 2023 +0100

    SampleGenerator code in place (untested)

commit 022724fa7a435371081fd489ee7e5dbfc2df37ec
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 10:17:05 2023 +0100

    cleanup and new approach (untested)

commit 4ac81f0924146a7ac3c46f4a4382e7dceaaac47c
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 17:26:12 2023 +0100

    fix 'classmethod is not callable' error

commit c875933096464a867a5c3cfbf9592605f201f79e
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 17:10:03 2023 +0100

    fix prompts log crash

commit 2771d52485191388dfa5b3b8892ed7327d874ed6
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 14:38:39 2023 +0100

    fix circular import

commit 8452272b02fe64a2345fba067a55e51c52debd98
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 14:33:26 2023 +0100

    refactor sample generation (untested)
2023-02-18 15:51:50 +01:00
nawnie 5e7a8b8d17
Typo
827 Siffusion to diffusion
2023-02-17 08:18:47 -06:00
Janek Mann 95165974ce fix roundtript text_encoder 2023-02-13 17:00:53 +00:00
Victor Hall 1665f07e61 assume epsilon for compatibility with old diffusers converted files 2023-02-08 15:42:07 -05:00
Victor Hall 6f4bfdc557 temporarily disable val, issues 2023-02-07 18:43:16 -05:00
Joel Holdbrooks 41c9f36ed7 GH-36: Add support for validation split (WIP)
Co-authored-by: Damian Stewart <office@damianstewart.com>
2023-02-06 22:10:34 -08:00
Victor Hall 94feea99ee fix colab notebook 2023-01-25 20:55:24 -05:00
Damian Stewart 6ee717c807 log a message on download 2023-01-23 19:45:23 +01:00
Damian Stewart 18fec68149 don't double-download data if safetensors files exist 2023-01-23 19:33:50 +01:00
Damian Stewart d24dd681c0 Merge remote-tracking branch 'upstream/main' into hf_model_download 2023-01-23 19:19:22 +01:00
Victor Hall 1c2708dc63 few sanity checks and remove keyboard 2023-01-20 09:42:24 -05:00
Victor Hall e09249b699 fix yaml detection 2023-01-18 20:24:44 -05:00
Victor Hall 23faf05512 save yaml with ckpt files for easier loading 2023-01-18 13:07:05 -05:00
Victor Hall 3e803a8313 deprecate ed1_mode, autodetect 2023-01-17 12:44:18 -05:00
Victor Hall 879f5bf33d amp mode work 2023-01-16 15:48:06 -05:00
Victor Hall ba25992140 merge 2023-01-15 22:07:37 -05:00
Damian Stewart 95fd9ebe79 read HF_API_TOKEN environment variable for authorization 2023-01-13 20:46:14 +01:00
Damian Stewart 4e6d8f1157 Merge remote-tracking branch 'upstream/main' into hf_model_download 2023-01-13 20:38:51 +01:00
Victor Hall 4209174360 issue with conv 2023-01-12 20:59:04 -05:00
Damian Stewart 2724f00752 enabled downloading model from huggingface 2023-01-12 23:08:31 +01:00
Victor Hall ca6cd6c4e0 fix bug with amp 2023-01-11 11:49:20 -05:00
Victor Hall bf869db2e2 update ed1 mode 2023-01-09 13:44:51 -05:00
Victor Hall acdbc6f0a4 ed1 emulation mode stuff 2023-01-06 16:36:51 -05:00
Victor Hall b316684bdb bunch of updates, grad ckpting, no drop bucket, shuffle every epoch 2023-01-01 10:45:18 -05:00
Victor Hall 46f84fc791 remove unneeded file 2022-12-30 23:04:58 -05:00
Victor Hall b5aea97408 conv update 2022-12-30 23:04:00 -05:00
Victor Hall 4c53f2d55c various tweaks and bugfixes over holidays 2022-12-27 14:25:32 -05:00
Victor Hall 2f0152dbe6 convert stuff 2022-12-17 23:01:25 -05:00
Victor Hall 179fd5395b hey look ed2 2022-12-17 22:32:48 -05:00