Commit Graph

797 Commits

Author SHA1 Message Date
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented.
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
2023-09-06 22:37:10 +03:00
alexds9 23df727a1f Added support for:
1. EMA decay. Using EMA decay model, it is updated every ema_decay_interval by (1 - ema_decay_rate), it can be stored on CPU to save VRAM. Only EMA model is saved now.
2. min_snr_gamma - improve converging speed, more info: https://arxiv.org/abs/2303.09556
3. load_settings_every_epoch - Will load 'train.json' at start of every epoch.
2023-09-06 13:38:52 +03:00
Victor Hall a7f94e96e0
set default resume_ckpt to sd1.5 2023-09-05 18:04:05 -04:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save
fixes for ZTSNR training
2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Victor Hall d6ef90bafc
add scipy to docker 2023-09-03 12:17:11 -04:00
Victor Hall 1bd8fa1881
Update windows_setup.cmd to bnb 41.1 2023-09-02 11:18:12 -04:00
Victor Hall 2000ec178d
Update requirements.txt 2023-08-31 12:46:46 -04:00
Victor Hall a33a62b786
Update requirements-runtime.txt
use newer bnb
2023-08-31 12:46:19 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Damian Stewart 4b824f3acd add samplers 2023-08-10 20:47:28 +02:00
Victor Hall 24b17efb08
Update optimizer_dadapt.json 2023-08-04 22:13:52 -04:00
Victor Hall d196865f4c
Update optimizer_dadapt.json 2023-08-04 22:13:21 -04:00
Victor Hall ab563a50e0
Update OPTIMIZER.md 2023-07-23 02:16:26 -04:00
Victor Hall a87b4ff92e
Update CHAINING.md 2023-07-16 18:10:34 -04:00
Victor Hall 28e3d22aff
Update ADVANCED_TWEAKING.md 2023-07-16 17:57:17 -04:00
Victor Hall a6032bee35
Update CAPTION.md 2023-07-11 15:46:41 -04:00
Victor Hall 8d133b6193 move img captio gui over to ed2 2023-07-08 23:56:03 -04:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 0d2755d654 add safetensors to docker runtime 2023-07-07 01:19:03 -04:00
Victor Hall 84cf90ed0c moar docs 2023-07-07 01:16:02 -04:00
Victor Hall cb1264fbe9 clarify convert doc 2023-07-07 01:11:59 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall cf772de298 update conv docs 2023-07-06 23:47:07 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Victor Hall 8007869b84 log exception if something blows up so it ends up in the .log 2023-07-05 16:02:18 -04:00
Victor Hall c7d3e77e9f add warning about sd21 and free colab 2023-07-05 15:51:50 -04:00
Victor Hall 318f8f8d0e add warning about sd21 and free colab 2023-07-05 15:51:00 -04:00
Victor Hall 4218901a08
Merge pull request #211 from a-l-e-x-d-s-9/main
Refactored the _percent_random_crop function to prevent unnecessary stretch.
2023-07-04 19:20:42 -04:00
Victor Hall c62516052b add plugin doc link 2023-07-04 17:36:57 -04:00
Victor Hall 2fd9fd76ff update plugin doc 2023-07-04 17:34:53 -04:00
Victor Hall f83934f5d3 improve plugins 2023-07-04 17:29:39 -04:00
Victor Hall 42c417171d improve plugins 2023-07-04 17:29:22 -04:00
Victor Hall 6907c01b51 fix caption fl 2023-07-03 15:58:30 -04:00
Victor Hall 2afea3bdb8 set highmem and t4 for colab 2023-07-03 15:37:29 -04:00
Victor Hall a75530471e enable float16 for older cards, t4, etc 2023-07-03 15:24:58 -04:00
Victor Hall 5d0f53646b
Update TWEAKING.md 2023-07-03 14:57:54 -04:00
Victor Hall 2407fef975
Update TWEAKING.md 2023-07-03 14:52:30 -04:00
Victor Hall 678638504d flamingo caption notebook beta 2023-07-03 14:27:17 -04:00
alexds9 7e5f8244b1 Refactored the _percent_random_crop function to make it simpler and cleaner.
- Removed the aspect ratio adjustment after cropping - which caused unnecessary stretch.
- Made sure that the crop pixels values are integers.
2023-07-03 18:39:24 +03:00
Victor Hall 7aed4e3e35 update captoin doc again 2023-06-30 12:41:33 -04:00
Victor Hall 4ddaf3349f cleanup caption doc 2023-06-30 00:40:49 -04:00
Victor Hall acac3f1547 update caption doc 2023-06-30 00:37:49 -04:00
Victor Hall 41eaa09938 document flamingo caption script 2023-06-30 00:28:07 -04:00
Victor Hall 1afaf59ec9 fix default for plugins 2023-06-29 22:00:16 -04:00
Victor Hall a72d455fc5 missed issue with plugin 2023-06-29 20:44:14 -04:00
Victor Hall e00b7b571a
Merge pull request #204 from victorchall/plugins
WIP plugins
2023-06-29 18:13:33 -04:00
Victor Hall 01b77f295e flamingo 2023-06-29 18:12:52 -04:00
Victor Hall aa7e004869 first crack at plugins 2023-06-27 20:53:48 -04:00