Mirrors
/
EveryDream2trainer
mirror of https://github.com/victorchall/EveryDream2trainer.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
812 Commits 6 Branches 0 Tags 5.4 MiB
Commit Graph

812 Commits

Author SHA1 Message Date
Victor Hall 303c8312e3 update ema sample args again 2023-09-18 16:12:51 -04:00
Victor Hall 29bab698a3 minor update to ema docs 2023-09-18 15:07:39 -04:00
Victor Hall 2f52832209 fix trainSD21.json and advanced tweaking ema param names 2023-09-18 14:54:43 -04:00
Victor Hall e4d93225f7 fix train21.json ema param names 2023-09-18 14:53:17 -04:00
Damian Stewart a68ebe3658 fix typo 2023-09-17 20:17:54 +02:00
Damian Stewart 3579bec540 cleanup 2023-09-17 20:17:33 +02:00
Damian Stewart 74c21602fc default every epoch not 3x per epoch 2023-09-17 20:16:29 +02:00
Damian Stewart 3fddef3698 put back make_save_path and fix error in plugin runner 2023-09-17 20:16:26 +02:00
Victor Hall fa5b38e26b some minor updates to ema 2023-09-12 21:37:27 -04:00
Victor Hall 49de395df1
Merge pull request #224 from a-l-e-x-d-s-9/main 
EMA decay, min-SNR-gamma, settings loading every epoch, zero terminal SNR separation from ZFN.
 2023-09-12 15:36:27 -04:00
alexds9 7259ce873b 1. Samples format change to make sure global step appear before "ema" indication. 2023-09-11 00:13:26 +03:00
alexds9 39b3082bf4 1. Making sure to release VRAM in samples. 2023-09-10 22:42:01 +03:00
alexds9 d2d493c911 1. New parameters added to train.json and trainSD21.json - disabled by default. 
2. Description added to ADVANCED_TWEAKING.md
 2023-09-10 20:06:50 +03:00
alexds9 5b1760fff2 1. Added an argument ema_decay_resume_model to load EMA model - it's loaded alongside main model, instead of copying normal model. It's optional, without loaded EMA model, it will copy the regular model to me the first EMA model, just like before. 
2. Fixed findlast option for regular models not to load EMA models by default.
3. findlast can be used to load EMA model too when used with ema_decay_resume_model.
4. Added ema_device variable to store the device in torch type.
5. Cleaned prints and comments.
 2023-09-07 19:53:20 +03:00
alexds9 cf4a082e11 1. Fix to EMA samples arguments not respecting False value. 2023-09-06 23:04:12 +03:00
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented. 
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
 2023-09-06 22:37:10 +03:00
alexds9 23df727a1f Added support for: 
1. EMA decay. Using EMA decay model, it is updated every ema_decay_interval by (1 - ema_decay_rate), it can be stored on CPU to save VRAM. Only EMA model is saved now.
2. min_snr_gamma - improve converging speed, more info: https://arxiv.org/abs/2303.09556
3. load_settings_every_epoch - Will load 'train.json' at start of every epoch.
 2023-09-06 13:38:52 +03:00
Victor Hall a7f94e96e0
set default resume_ckpt to sd1.5 2023-09-05 18:04:05 -04:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save 
fixes for ZTSNR training
 2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Victor Hall d6ef90bafc
add scipy to docker 2023-09-03 12:17:11 -04:00
Victor Hall 1bd8fa1881
Update windows_setup.cmd to bnb 41.1 2023-09-02 11:18:12 -04:00
Victor Hall 2000ec178d
Update requirements.txt 2023-08-31 12:46:46 -04:00
Victor Hall a33a62b786
Update requirements-runtime.txt 
use newer bnb
 2023-08-31 12:46:19 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Damian Stewart 4b824f3acd add samplers 2023-08-10 20:47:28 +02:00
Victor Hall 24b17efb08
Update optimizer_dadapt.json 2023-08-04 22:13:52 -04:00
Victor Hall d196865f4c
Update optimizer_dadapt.json 2023-08-04 22:13:21 -04:00
Victor Hall ab563a50e0
Update OPTIMIZER.md 2023-07-23 02:16:26 -04:00
Victor Hall a87b4ff92e
Update CHAINING.md 2023-07-16 18:10:34 -04:00
Victor Hall 28e3d22aff
Update ADVANCED_TWEAKING.md 2023-07-16 17:57:17 -04:00
Victor Hall a6032bee35
Update CAPTION.md 2023-07-11 15:46:41 -04:00
Victor Hall 8d133b6193 move img captio gui over to ed2 2023-07-08 23:56:03 -04:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 0d2755d654 add safetensors to docker runtime 2023-07-07 01:19:03 -04:00
Victor Hall 84cf90ed0c moar docs 2023-07-07 01:16:02 -04:00
Victor Hall cb1264fbe9 clarify convert doc 2023-07-07 01:11:59 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall cf772de298 update conv docs 2023-07-06 23:47:07 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Victor Hall 8007869b84 log exception if something blows up so it ends up in the .log 2023-07-05 16:02:18 -04:00
Victor Hall c7d3e77e9f add warning about sd21 and free colab 2023-07-05 15:51:50 -04:00
Victor Hall 318f8f8d0e add warning about sd21 and free colab 2023-07-05 15:51:00 -04:00
Victor Hall 4218901a08
Merge pull request #211 from a-l-e-x-d-s-9/main 
Refactored the _percent_random_crop function to prevent unnecessary stretch.
 2023-07-04 19:20:42 -04:00
Victor Hall c62516052b add plugin doc link 2023-07-04 17:36:57 -04:00
Victor Hall 2fd9fd76ff update plugin doc 2023-07-04 17:34:53 -04:00
Victor Hall f83934f5d3 improve plugins 2023-07-04 17:29:39 -04:00
Victor Hall 42c417171d improve plugins 2023-07-04 17:29:22 -04:00
Victor Hall 6907c01b51 fix caption fl 2023-07-03 15:58:30 -04:00