Commit Graph

74 Commits

Author SHA1 Message Date
alexds9 7259ce873b 1. Samples format change to make sure global step appear before "ema" indication. 2023-09-11 00:13:26 +03:00
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented.
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
2023-09-06 22:37:10 +03:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save
fixes for ZTSNR training
2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Damian Stewart a8c6a59111 fix bug with empty samples.txt 2023-06-17 11:04:14 +02:00
Victor Hall b69793623b allow latin-1 encoded txt files 2023-06-11 17:55:29 -04:00
Victor Hall 642b832ca0 remove failure when people do weird custom configs on models 2023-06-10 16:29:03 -04:00
Damian Stewart 17d9165c36 remove deepcopies 2023-06-08 20:34:51 +02:00
damian 59fc9891d4 shuffle named batches while respecting and accounting for grad_accum 2023-06-07 18:07:37 +02:00
Damian Stewart a8455b9427 wip first fit decreasing for batch/grad accum shuffling 2023-06-07 13:49:06 +02:00
Victor Hall 803cadfd53 missed checkin 2023-05-27 01:03:01 -04:00
Victor Hall e6a176ea28 new bnb and beta zero terminal snr 2023-05-26 21:54:02 -04:00
Victor Hall 970065c206 more wip optimizer splitting 2023-05-04 20:15:36 -04:00
Victor Hall 29a19fd8b1 check if your git commit is out of date 2023-04-29 18:15:25 -04:00
Alexander f431668cba forgot .items() 2023-04-20 17:08:19 +03:00
Alexander 8803d04cfe fixed weight conversion 2023-04-20 17:07:07 +03:00
Damian Stewart 6531a3f120 remove erroneous cast() 2023-04-15 01:52:36 +02:00
Damian Stewart 5bf5d4026d cast() to fix type mismatch warnings 2023-04-14 20:45:15 +02:00
Damian Stewart 9b663cd23e use compel for sample prompting; enable clip skip for samples 2023-04-14 19:12:06 +02:00
Augusto de la Torre 49f6c14622 Fix handling of unix/mac hidden files 2023-04-01 00:29:10 +02:00
Augusto de la Torre cdafa2dc43 Avoid unnecessary iteration over files in folder 2023-03-21 12:09:52 +01:00
Augusto de la Torre 0716c40ab6 Add support for enhanced dataset configuration
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00
Damian Stewart 29c93eca03 if progress bars are disabled, log a short message instead 2023-03-03 10:50:48 +01:00
Damian Stewart c4d37862ba document new sample generator params 2023-03-02 23:12:47 +01:00
Damian Stewart fe0083877f add aspect_ratio arg to sample generation 2023-03-02 22:16:21 +01:00
Damian Stewart 52c722714c Merge branch 'feat_text_encoder_LR' of github.com:damian0815/EveryDream2trainer into feat_text_encoder_LR 2023-03-02 20:02:38 +01:00
damian 61558be2ae logging and progress bar improvements 2023-03-02 18:29:28 +01:00
Damian Stewart 17c61db5ca wip aspect ratio samples 2023-03-02 14:50:17 +01:00
Damian Stewart 8100e42159 fix issues and improve sample generator 2023-03-02 13:03:50 +01:00
nawnie e9ba16f544
sample updates
add more samplers
2023-02-27 18:14:23 -06:00
Victor Hall e7fc71ffa1
Merge pull request #92 from victorchall/lion
fix mem leak on huge data, rework optimizer to separate json, add lio…
2023-02-25 16:20:10 -05:00
Victor Hall a9b0189947 fix mem leak on huge data, rework optimizer to separate json, add lion optimizer 2023-02-25 15:05:22 -05:00
Victor Hall 30c7b2f96d
Merge pull request #83 from damian0815/fix-huggingface-download-safetensors-models
use StableDiffusionPipeline.from_pretrained() to download HF models
2023-02-21 11:37:23 -05:00
Damian Stewart 4646af7434 use StableDiffusionPipeline.from_pretrained() to download the model 2023-02-20 22:00:25 +01:00
Damian Stewart be8cdf8af8 actually use validation seed 😭 also fix log of sample negative prompt 2023-02-20 21:58:46 +01:00
Damian Stewart 60702ee040 some validation tweaks and fixes 2023-02-19 10:20:16 +01:00
Victor Hall c071230a49
Merge pull request #75 from damian0815/sample_generation_refactor_redo
Refactor sample generation and introduce sample_prompts.json
2023-02-18 14:42:55 -05:00
Damian Stewart 230cab9e27 isolate RNG in sample generation 2023-02-18 20:18:21 +01:00
Damian Stewart 759623142a more cleanly fall back to random captions 2023-02-18 19:28:08 +01:00
Damian Stewart 648fe20200 better default batch size handling 2023-02-18 15:55:54 +01:00
Damian Stewart e97f0816db Squashed commit of the following:
commit 86fa1363852850e87be11e5a277b71435f6a3451
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 14:43:57 2023 +0100

    cleanup, add back random caption support

commit f9a10842b47b9a5d51d53de8d56cb7089a1eeeb2
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 13:52:22 2023 +0100

    misc fixes and documentation

commit 46167806892258fef509f14e9d83ceab08725cd6
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 12:11:18 2023 +0100

    works

commit 390bcdf4d8165315e2f84404c62b410c7b674c84
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 10:12:14 2023 +0100

    SampleGenerator code in place (untested)

commit 022724fa7a435371081fd489ee7e5dbfc2df37ec
Author: Damian Stewart <d@damianstewart.com>
Date:   Sat Feb 18 10:17:05 2023 +0100

    cleanup and new approach (untested)

commit 4ac81f0924146a7ac3c46f4a4382e7dceaaac47c
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 17:26:12 2023 +0100

    fix 'classmethod is not callable' error

commit c875933096464a867a5c3cfbf9592605f201f79e
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 17:10:03 2023 +0100

    fix prompts log crash

commit 2771d52485191388dfa5b3b8892ed7327d874ed6
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 14:38:39 2023 +0100

    fix circular import

commit 8452272b02fe64a2345fba067a55e51c52debd98
Author: Damian Stewart <d@damianstewart.com>
Date:   Fri Jan 27 14:33:26 2023 +0100

    refactor sample generation (untested)
2023-02-18 15:51:50 +01:00
nawnie 5e7a8b8d17
Typo
827 Siffusion to diffusion
2023-02-17 08:18:47 -06:00
Janek Mann 95165974ce fix roundtript text_encoder 2023-02-13 17:00:53 +00:00
Victor Hall 1665f07e61 assume epsilon for compatibility with old diffusers converted files 2023-02-08 15:42:07 -05:00
Victor Hall 6f4bfdc557 temporarily disable val, issues 2023-02-07 18:43:16 -05:00