Mirrors
/
EveryDream2trainer
mirror of https://github.com/victorchall/EveryDream2trainer.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
670 Commits 6 Branches 0 Tags 5.4 MiB
Commit Graph

670 Commits

Author SHA1 Message Date
Victor Hall 78a4c13c4c add prodigyopt requirements 2023-09-22 13:46:25 -04:00
Victor Hall 5444abfd7b finalize lion8bit and add prodigy 2023-09-22 12:15:32 -04:00
Victor Hall a9c98f5866 bugged flag 2023-09-22 10:16:56 -04:00
Victor Hall 166c2e74e1 off by one on last epoch save 2023-09-21 21:29:36 -04:00
Victor Hall ada6037463 add bnb lion8bit support 2023-09-21 13:48:40 -04:00
Victor Hall a47d65799f early work on pinned image tensor 2023-09-21 13:48:40 -04:00
Victor Hall 6c8d15daab
Merge pull request #209 from damian0815/feat_rolling_save 
Feature: Rolling save ckpt
 2023-09-20 16:32:48 -04:00
Victor Hall 09aa13c3dd
Merge branch 'main' into feat_rolling_save 2023-09-20 16:32:37 -04:00
Victor Hall 2dff3aa8d1 ema update 2023-09-18 16:13:22 -04:00
Victor Hall 303c8312e3 update ema sample args again 2023-09-18 16:12:51 -04:00
Victor Hall 29bab698a3 minor update to ema docs 2023-09-18 15:07:39 -04:00
Victor Hall 2f52832209 fix trainSD21.json and advanced tweaking ema param names 2023-09-18 14:54:43 -04:00
Victor Hall e4d93225f7 fix train21.json ema param names 2023-09-18 14:53:17 -04:00
Damian Stewart a68ebe3658 fix typo 2023-09-17 20:17:54 +02:00
Damian Stewart 3579bec540 cleanup 2023-09-17 20:17:33 +02:00
Damian Stewart 74c21602fc default every epoch not 3x per epoch 2023-09-17 20:16:29 +02:00
Damian Stewart 3fddef3698 put back make_save_path and fix error in plugin runner 2023-09-17 20:16:26 +02:00
Victor Hall fa5b38e26b some minor updates to ema 2023-09-12 21:37:27 -04:00
Victor Hall 49de395df1
Merge pull request #224 from a-l-e-x-d-s-9/main 
EMA decay, min-SNR-gamma, settings loading every epoch, zero terminal SNR separation from ZFN.
 2023-09-12 15:36:27 -04:00
alexds9 7259ce873b 1. Samples format change to make sure global step appear before "ema" indication. 2023-09-11 00:13:26 +03:00
alexds9 39b3082bf4 1. Making sure to release VRAM in samples. 2023-09-10 22:42:01 +03:00
alexds9 d2d493c911 1. New parameters added to train.json and trainSD21.json - disabled by default. 
2. Description added to ADVANCED_TWEAKING.md
 2023-09-10 20:06:50 +03:00
alexds9 5b1760fff2 1. Added an argument ema_decay_resume_model to load EMA model - it's loaded alongside main model, instead of copying normal model. It's optional, without loaded EMA model, it will copy the regular model to me the first EMA model, just like before. 
2. Fixed findlast option for regular models not to load EMA models by default.
3. findlast can be used to load EMA model too when used with ema_decay_resume_model.
4. Added ema_device variable to store the device in torch type.
5. Cleaned prints and comments.
 2023-09-07 19:53:20 +03:00
alexds9 cf4a082e11 1. Fix to EMA samples arguments not respecting False value. 2023-09-06 23:04:12 +03:00
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented. 
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
 2023-09-06 22:37:10 +03:00
alexds9 23df727a1f Added support for: 
1. EMA decay. Using EMA decay model, it is updated every ema_decay_interval by (1 - ema_decay_rate), it can be stored on CPU to save VRAM. Only EMA model is saved now.
2. min_snr_gamma - improve converging speed, more info: https://arxiv.org/abs/2303.09556
3. load_settings_every_epoch - Will load 'train.json' at start of every epoch.
 2023-09-06 13:38:52 +03:00
Victor Hall a7f94e96e0
set default resume_ckpt to sd1.5 2023-09-05 18:04:05 -04:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save 
fixes for ZTSNR training
 2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Victor Hall d6ef90bafc
add scipy to docker 2023-09-03 12:17:11 -04:00
Victor Hall 1bd8fa1881
Update windows_setup.cmd to bnb 41.1 2023-09-02 11:18:12 -04:00
Victor Hall 2000ec178d
Update requirements.txt 2023-08-31 12:46:46 -04:00
Victor Hall a33a62b786
Update requirements-runtime.txt 
use newer bnb
 2023-08-31 12:46:19 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Victor Hall 24b17efb08
Update optimizer_dadapt.json 2023-08-04 22:13:52 -04:00
Victor Hall d196865f4c
Update optimizer_dadapt.json 2023-08-04 22:13:21 -04:00
Victor Hall ab563a50e0
Update OPTIMIZER.md 2023-07-23 02:16:26 -04:00
Victor Hall a87b4ff92e
Update CHAINING.md 2023-07-16 18:10:34 -04:00
Victor Hall 28e3d22aff
Update ADVANCED_TWEAKING.md 2023-07-16 17:57:17 -04:00
Victor Hall a6032bee35
Update CAPTION.md 2023-07-11 15:46:41 -04:00
Victor Hall 8d133b6193 move img captio gui over to ed2 2023-07-08 23:56:03 -04:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 0d2755d654 add safetensors to docker runtime 2023-07-07 01:19:03 -04:00
Victor Hall 84cf90ed0c moar docs 2023-07-07 01:16:02 -04:00
Victor Hall cb1264fbe9 clarify convert doc 2023-07-07 01:11:59 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall cf772de298 update conv docs 2023-07-06 23:47:07 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Victor Hall 8007869b84 log exception if something blows up so it ends up in the .log 2023-07-05 16:02:18 -04:00