Mirrors
/
EveryDream2trainer
mirror of https://github.com/victorchall/EveryDream2trainer.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
802 Commits 6 Branches 0 Tags 5.4 MiB
Commit Graph

802 Commits

Author SHA1 Message Date
alexds9 7259ce873b 1. Samples format change to make sure global step appear before "ema" indication. 2023-09-11 00:13:26 +03:00
alexds9 39b3082bf4 1. Making sure to release VRAM in samples. 2023-09-10 22:42:01 +03:00
alexds9 d2d493c911 1. New parameters added to train.json and trainSD21.json - disabled by default. 
2. Description added to ADVANCED_TWEAKING.md
 2023-09-10 20:06:50 +03:00
alexds9 5b1760fff2 1. Added an argument ema_decay_resume_model to load EMA model - it's loaded alongside main model, instead of copying normal model. It's optional, without loaded EMA model, it will copy the regular model to me the first EMA model, just like before. 
2. Fixed findlast option for regular models not to load EMA models by default.
3. findlast can be used to load EMA model too when used with ema_decay_resume_model.
4. Added ema_device variable to store the device in torch type.
5. Cleaned prints and comments.
 2023-09-07 19:53:20 +03:00
alexds9 cf4a082e11 1. Fix to EMA samples arguments not respecting False value. 2023-09-06 23:04:12 +03:00
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented. 
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
 2023-09-06 22:37:10 +03:00
alexds9 23df727a1f Added support for: 
1. EMA decay. Using EMA decay model, it is updated every ema_decay_interval by (1 - ema_decay_rate), it can be stored on CPU to save VRAM. Only EMA model is saved now.
2. min_snr_gamma - improve converging speed, more info: https://arxiv.org/abs/2303.09556
3. load_settings_every_epoch - Will load 'train.json' at start of every epoch.
 2023-09-06 13:38:52 +03:00
Victor Hall a7f94e96e0
set default resume_ckpt to sd1.5 2023-09-05 18:04:05 -04:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save 
fixes for ZTSNR training
 2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Victor Hall d6ef90bafc
add scipy to docker 2023-09-03 12:17:11 -04:00
Victor Hall 1bd8fa1881
Update windows_setup.cmd to bnb 41.1 2023-09-02 11:18:12 -04:00
Victor Hall 2000ec178d
Update requirements.txt 2023-08-31 12:46:46 -04:00
Victor Hall a33a62b786
Update requirements-runtime.txt 
use newer bnb
 2023-08-31 12:46:19 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Damian Stewart 4b824f3acd add samplers 2023-08-10 20:47:28 +02:00
Victor Hall 24b17efb08
Update optimizer_dadapt.json 2023-08-04 22:13:52 -04:00
Victor Hall d196865f4c
Update optimizer_dadapt.json 2023-08-04 22:13:21 -04:00
Victor Hall ab563a50e0
Update OPTIMIZER.md 2023-07-23 02:16:26 -04:00
Victor Hall a87b4ff92e
Update CHAINING.md 2023-07-16 18:10:34 -04:00
Victor Hall 28e3d22aff
Update ADVANCED_TWEAKING.md 2023-07-16 17:57:17 -04:00
Victor Hall a6032bee35
Update CAPTION.md 2023-07-11 15:46:41 -04:00
Victor Hall 8d133b6193 move img captio gui over to ed2 2023-07-08 23:56:03 -04:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 0d2755d654 add safetensors to docker runtime 2023-07-07 01:19:03 -04:00
Victor Hall 84cf90ed0c moar docs 2023-07-07 01:16:02 -04:00
Victor Hall cb1264fbe9 clarify convert doc 2023-07-07 01:11:59 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall cf772de298 update conv docs 2023-07-06 23:47:07 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Victor Hall 8007869b84 log exception if something blows up so it ends up in the .log 2023-07-05 16:02:18 -04:00
Victor Hall c7d3e77e9f add warning about sd21 and free colab 2023-07-05 15:51:50 -04:00
Victor Hall 318f8f8d0e add warning about sd21 and free colab 2023-07-05 15:51:00 -04:00
Victor Hall 4218901a08
Merge pull request #211 from a-l-e-x-d-s-9/main 
Refactored the _percent_random_crop function to prevent unnecessary stretch.
 2023-07-04 19:20:42 -04:00
Victor Hall c62516052b add plugin doc link 2023-07-04 17:36:57 -04:00
Victor Hall 2fd9fd76ff update plugin doc 2023-07-04 17:34:53 -04:00
Victor Hall f83934f5d3 improve plugins 2023-07-04 17:29:39 -04:00
Victor Hall 42c417171d improve plugins 2023-07-04 17:29:22 -04:00
Victor Hall 6907c01b51 fix caption fl 2023-07-03 15:58:30 -04:00
Victor Hall 2afea3bdb8 set highmem and t4 for colab 2023-07-03 15:37:29 -04:00
Victor Hall a75530471e enable float16 for older cards, t4, etc 2023-07-03 15:24:58 -04:00
Victor Hall 5d0f53646b
Update TWEAKING.md 2023-07-03 14:57:54 -04:00
Victor Hall 2407fef975
Update TWEAKING.md 2023-07-03 14:52:30 -04:00
Victor Hall 678638504d flamingo caption notebook beta 2023-07-03 14:27:17 -04:00
alexds9 7e5f8244b1 Refactored the _percent_random_crop function to make it simpler and cleaner. 
- Removed the aspect ratio adjustment after cropping - which caused unnecessary stretch.
- Made sure that the crop pixels values are integers.
 2023-07-03 18:39:24 +03:00
Victor Hall 7aed4e3e35 update captoin doc again 2023-06-30 12:41:33 -04:00
Victor Hall 4ddaf3349f cleanup caption doc 2023-06-30 00:40:49 -04:00
Victor Hall acac3f1547 update caption doc 2023-06-30 00:37:49 -04:00
Victor Hall 41eaa09938 document flamingo caption script 2023-06-30 00:28:07 -04:00