scottshireman
dc756ce22a
Update sample_generator.py
...
Changed {sample_index} to {sample_index:03} in file names and logs for sample generator to allow for proper sorting in wandb and other places when there are more than 10 samples as currently wandb sorts as follows: 0, 1, 10, 11, 2, etc. With this change it would be 000, 001, 002, ... , 010, 011, etc.
2024-12-03 08:47:28 -05:00
Victor Hall
dcbd9d45a9
add kwargs to cog patch for compatibility with newer diffusers versions
2024-06-18 18:24:23 -04:00
Victor Hall
fb1caf52a7
add llava captioning
2024-05-04 22:24:24 -04:00
Victor Hall
3a6fe3b4a1
add huber loss, timestep clamping, slightly safer txt reading
2024-04-26 23:54:31 -04:00
Victor Hall
17054c9d10
patch cog to fix issue with transformers
2024-03-15 00:18:55 -04:00
Victor Hall
1236329677
fix reshaping for picking apps
2023-11-29 22:17:52 -05:00
Victor Hall
a05ffca82e
add positions id back for clip-l
2023-11-29 20:25:38 -05:00
Victor Hall
49e382c82b
script to backdate autoencoderkl keys due to other broken software
2023-11-29 19:02:50 -05:00
Victor Hall
e95a8861e9
workaround for cuda errors on some rented machines
2023-11-15 14:45:43 -05:00
Victor Hall
a95d2de150
fix ckpt to diffusers conversion script
2023-11-15 12:55:22 -05:00
Victor Hall
299af88f22
save as safetensors not ckpt
2023-11-13 13:12:42 -05:00
Damian Stewart
bc1058a0d5
Merge branch 'victorchall:main' into feat_add_sde_samplers
2023-10-23 00:04:03 +02:00
alexds9
7259ce873b
1. Samples format change to make sure global step appear before "ema" indication.
2023-09-11 00:13:26 +03:00
alexds9
5bcf9407f0
1. Improved EMA support: samples generation with arguments EMA/NOT-EMA, saving checkpoints and diffusers for both, ema_decay_target implemented.
...
2. enable_zero_terminal_snr separated from zero_frequency_noise_ratio.
2023-09-06 22:37:10 +03:00
Victor Hall
3954182e45
Merge pull request #220 from damian0815/fix_ztsnr_samples_and_save
...
fixes for ZTSNR training
2023-09-03 17:57:27 -04:00
Victor Hall
d493d16504
fix conv
2023-09-03 16:05:12 -04:00
Damian Stewart
9b5b96a50b
fixes for ZTSNR training
2023-08-15 20:49:28 +02:00
Damian Stewart
4b824f3acd
add samplers
2023-08-10 20:47:28 +02:00
Victor Hall
d4f62177fe
remove errant input
2023-07-08 14:59:38 -04:00
Victor Hall
69574fcaa4
fix hf downloads
2023-07-08 14:23:50 -04:00
Victor Hall
7686bcd66e
update diffusers to 0.18.0 on all platforms
2023-07-07 00:58:05 -04:00
Victor Hall
c279a0b3ec
update conversion script
2023-07-06 23:16:14 -04:00
Damian Stewart
a8c6a59111
fix bug with empty samples.txt
2023-06-17 11:04:14 +02:00
Victor Hall
b69793623b
allow latin-1 encoded txt files
2023-06-11 17:55:29 -04:00
Victor Hall
642b832ca0
remove failure when people do weird custom configs on models
2023-06-10 16:29:03 -04:00
Damian Stewart
17d9165c36
remove deepcopies
2023-06-08 20:34:51 +02:00
damian
59fc9891d4
shuffle named batches while respecting and accounting for grad_accum
2023-06-07 18:07:37 +02:00
Damian Stewart
a8455b9427
wip first fit decreasing for batch/grad accum shuffling
2023-06-07 13:49:06 +02:00
Victor Hall
803cadfd53
missed checkin
2023-05-27 01:03:01 -04:00
Victor Hall
e6a176ea28
new bnb and beta zero terminal snr
2023-05-26 21:54:02 -04:00
Victor Hall
970065c206
more wip optimizer splitting
2023-05-04 20:15:36 -04:00
Victor Hall
29a19fd8b1
check if your git commit is out of date
2023-04-29 18:15:25 -04:00
Alexander
f431668cba
forgot .items()
2023-04-20 17:08:19 +03:00
Alexander
8803d04cfe
fixed weight conversion
2023-04-20 17:07:07 +03:00
Damian Stewart
6531a3f120
remove erroneous cast()
2023-04-15 01:52:36 +02:00
Damian Stewart
5bf5d4026d
cast() to fix type mismatch warnings
2023-04-14 20:45:15 +02:00
Damian Stewart
9b663cd23e
use compel for sample prompting; enable clip skip for samples
2023-04-14 19:12:06 +02:00
Augusto de la Torre
49f6c14622
Fix handling of unix/mac hidden files
2023-04-01 00:29:10 +02:00
Augusto de la Torre
cdafa2dc43
Avoid unnecessary iteration over files in folder
2023-03-21 12:09:52 +01:00
Augusto de la Torre
0716c40ab6
Add support for enhanced dataset configuration
...
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00
Damian Stewart
29c93eca03
if progress bars are disabled, log a short message instead
2023-03-03 10:50:48 +01:00
Damian Stewart
c4d37862ba
document new sample generator params
2023-03-02 23:12:47 +01:00
Damian Stewart
fe0083877f
add aspect_ratio arg to sample generation
2023-03-02 22:16:21 +01:00
Damian Stewart
52c722714c
Merge branch 'feat_text_encoder_LR' of github.com:damian0815/EveryDream2trainer into feat_text_encoder_LR
2023-03-02 20:02:38 +01:00
damian
61558be2ae
logging and progress bar improvements
2023-03-02 18:29:28 +01:00
Damian Stewart
17c61db5ca
wip aspect ratio samples
2023-03-02 14:50:17 +01:00
Damian Stewart
8100e42159
fix issues and improve sample generator
2023-03-02 13:03:50 +01:00
nawnie
e9ba16f544
sample updates
...
add more samplers
2023-02-27 18:14:23 -06:00
Victor Hall
e7fc71ffa1
Merge pull request #92 from victorchall/lion
...
fix mem leak on huge data, rework optimizer to separate json, add lio…
2023-02-25 16:20:10 -05:00
Victor Hall
a9b0189947
fix mem leak on huge data, rework optimizer to separate json, add lion optimizer
2023-02-25 15:05:22 -05:00