Commit Graph

87 Commits

Author SHA1 Message Date
scottshireman dc756ce22a
Update sample_generator.py
Changed {sample_index} to {sample_index:03} in file names and logs for sample generator to allow for proper sorting in wandb and other places when there are more than 10 samples as currently wandb sorts as follows: 0, 1, 10, 11, 2, etc. With this change it would be 000, 001, 002, ... , 010, 011, etc.
2024-12-03 08:47:28 -05:00
Victor Hall dcbd9d45a9 add kwargs to cog patch for compatibility with newer diffusers versions 2024-06-18 18:24:23 -04:00
Victor Hall fb1caf52a7 add llava captioning 2024-05-04 22:24:24 -04:00
Victor Hall 3a6fe3b4a1 add huber loss, timestep clamping, slightly safer txt reading 2024-04-26 23:54:31 -04:00
Victor Hall 17054c9d10 patch cog to fix issue with transformers 2024-03-15 00:18:55 -04:00
Victor Hall 1236329677 fix reshaping for picking apps 2023-11-29 22:17:52 -05:00
Victor Hall a05ffca82e add positions id back for clip-l 2023-11-29 20:25:38 -05:00
Victor Hall 49e382c82b script to backdate autoencoderkl keys due to other broken software 2023-11-29 19:02:50 -05:00
Victor Hall e95a8861e9 workaround for cuda errors on some rented machines 2023-11-15 14:45:43 -05:00
Victor Hall a95d2de150 fix ckpt to diffusers conversion script 2023-11-15 12:55:22 -05:00
Victor Hall 299af88f22 save as safetensors not ckpt 2023-11-13 13:12:42 -05:00
Damian Stewart bc1058a0d5
Merge branch 'victorchall:main' into feat_add_sde_samplers 2023-10-23 00:04:03 +02:00
alexds9 7259ce873b 1. Samples format change to make sure global step appear before "ema" indication. 2023-09-11 00:13:26 +03:00
alexds9 5bcf9407f0 1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented.
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
2023-09-06 22:37:10 +03:00
Victor Hall 3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save
fixes for ZTSNR training
2023-09-03 17:57:27 -04:00
Victor Hall d493d16504 fix conv 2023-09-03 16:05:12 -04:00
Damian Stewart 9b5b96a50b fixes for ZTSNR training 2023-08-15 20:49:28 +02:00
Damian Stewart 4b824f3acd add samplers 2023-08-10 20:47:28 +02:00
Victor Hall d4f62177fe remove errant input 2023-07-08 14:59:38 -04:00
Victor Hall 69574fcaa4 fix hf downloads 2023-07-08 14:23:50 -04:00
Victor Hall 7686bcd66e update diffusers to 0.18.0 on all platforms 2023-07-07 00:58:05 -04:00
Victor Hall c279a0b3ec update conversion script 2023-07-06 23:16:14 -04:00
Damian Stewart a8c6a59111 fix bug with empty samples.txt 2023-06-17 11:04:14 +02:00
Victor Hall b69793623b allow latin-1 encoded txt files 2023-06-11 17:55:29 -04:00
Victor Hall 642b832ca0 remove failure when people do weird custom configs on models 2023-06-10 16:29:03 -04:00
Damian Stewart 17d9165c36 remove deepcopies 2023-06-08 20:34:51 +02:00
damian 59fc9891d4 shuffle named batches while respecting and accounting for grad_accum 2023-06-07 18:07:37 +02:00
Damian Stewart a8455b9427 wip first fit decreasing for batch/grad accum shuffling 2023-06-07 13:49:06 +02:00
Victor Hall 803cadfd53 missed checkin 2023-05-27 01:03:01 -04:00
Victor Hall e6a176ea28 new bnb and beta zero terminal snr 2023-05-26 21:54:02 -04:00
Victor Hall 970065c206 more wip optimizer splitting 2023-05-04 20:15:36 -04:00
Victor Hall 29a19fd8b1 check if your git commit is out of date 2023-04-29 18:15:25 -04:00
Alexander f431668cba forgot .items() 2023-04-20 17:08:19 +03:00
Alexander 8803d04cfe fixed weight conversion 2023-04-20 17:07:07 +03:00
Damian Stewart 6531a3f120 remove erroneous cast() 2023-04-15 01:52:36 +02:00
Damian Stewart 5bf5d4026d cast() to fix type mismatch warnings 2023-04-14 20:45:15 +02:00
Damian Stewart 9b663cd23e use compel for sample prompting; enable clip skip for samples 2023-04-14 19:12:06 +02:00
Augusto de la Torre 49f6c14622 Fix handling of unix/mac hidden files 2023-04-01 00:29:10 +02:00
Augusto de la Torre cdafa2dc43 Avoid unnecessary iteration over files in folder 2023-03-21 12:09:52 +01:00
Augusto de la Torre 0716c40ab6 Add support for enhanced dataset configuration
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00
Damian Stewart 29c93eca03 if progress bars are disabled, log a short message instead 2023-03-03 10:50:48 +01:00
Damian Stewart c4d37862ba document new sample generator params 2023-03-02 23:12:47 +01:00
Damian Stewart fe0083877f add aspect_ratio arg to sample generation 2023-03-02 22:16:21 +01:00
Damian Stewart 52c722714c Merge branch 'feat_text_encoder_LR' of github.com:damian0815/EveryDream2trainer into feat_text_encoder_LR 2023-03-02 20:02:38 +01:00
damian 61558be2ae logging and progress bar improvements 2023-03-02 18:29:28 +01:00
Damian Stewart 17c61db5ca wip aspect ratio samples 2023-03-02 14:50:17 +01:00
Damian Stewart 8100e42159 fix issues and improve sample generator 2023-03-02 13:03:50 +01:00
nawnie e9ba16f544
sample updates
add more samplers
2023-02-27 18:14:23 -06:00
Victor Hall e7fc71ffa1
Merge pull request #92 from victorchall/lion
fix mem leak on huge data, rework optimizer to separate json, add lio…
2023-02-25 16:20:10 -05:00
Victor Hall a9b0189947 fix mem leak on huge data, rework optimizer to separate json, add lion optimizer 2023-02-25 15:05:22 -05:00