939f16529a
only save 1 image per embedding
2022-10-15 17:23:39 +03:00
9e846083b7
add vector size to embed text
2022-10-15 17:23:39 +03:00
7b7561f6e4
Merge branch 'master' into test_resolve_conflicts
2022-10-15 16:20:17 +02:00
ea8aa1701a
Merge branch 'master' into master
2022-10-15 10:13:16 +03:00
c7a86f7fe9
add option to use batch size for training
2022-10-15 09:24:59 +03:00
4d19f3b7d4
Raise an assertion error if no training images have been found.
2022-10-14 22:45:26 +02:00
03d62538ae
remove duplicate code for log loss, add step, make it read from options rather than gradio input
2022-10-14 22:43:55 +03:00
326fe7d44b
Merge remote-tracking branch 'Melanpan/master'
2022-10-14 22:14:50 +03:00
c344ba3b32
add option to read generation params for learning previews from txt2img
2022-10-14 20:31:49 +03:00
bb57f30c2d
init
2022-10-14 10:56:41 +02:00
8636b50aea
Add learn_rate to csv and removed a left-over debug statement
2022-10-13 12:37:58 +02:00
1cfc2a1898
Save a csv containing the loss while training
2022-10-12 23:36:29 +02:00
f776254b12
[2/?] [wip] ignore OPT_INCLUDE_RANKS for training filenames
2022-10-12 13:12:18 -07:00
698d303b04
deepbooru: added option to use spaces or underscores
...
deepbooru: added option to quote (\) in tags
deepbooru/BLIP: write caption to file instead of image filename
deepbooru/BLIP: now possible to use both for captions
deepbooru: process is stopped even if an exception occurs
2022-10-12 21:55:43 +03:00
c3c8eef9fd
train: change filename processing to be more simple and configurable
...
train: make it possible to make text files with prompts
train: rework scheduler so that there's less repeating code in textual inversion and hypernets
train: move epochs setting to options
2022-10-12 20:49:47 +03:00
cc5803603b
Merge pull request #2037 from AUTOMATIC1111/embed-embeddings-in-images
...
Add option to store TI embeddings in png chunks, and load from same.
2022-10-12 15:59:24 +03:00
10a2de644f
formatting
2022-10-12 13:15:35 +01:00
50be33e953
formatting
2022-10-12 13:13:25 +01:00
f53f703aeb
resolved conflicts, moved settings under interrogate section, settings only show if deepbooru flag is enabled
2022-10-11 18:12:12 -05:00
963d986396
Merge branch 'AUTOMATIC1111:master' into deepdanbooru_pre_process
2022-10-11 17:33:15 -05:00
6be32b31d1
reports that training with medvram is possible.
2022-10-11 23:07:09 +03:00
66ec505975
add file based test
2022-10-11 20:21:30 +01:00
7e6a6e00ad
Add files via upload
2022-10-11 20:20:46 +01:00
5f3317376b
spacing
2022-10-11 20:09:49 +01:00
91d7ee0d09
update imports
2022-10-11 20:09:10 +01:00
aa75d5cfe8
correct conflict resolution typo
2022-10-11 20:06:13 +01:00
d6fcc6b87b
apply lr schedule to hypernets
2022-10-11 22:03:05 +03:00
db71290d26
remove old caption method
2022-10-11 19:55:54 +01:00
61788c0538
shift embedding logic out of textual_inversion
2022-10-11 19:50:50 +01:00
419e539fe3
Merge branch 'learning_rate-scheduling' into learnschedule
2022-10-11 21:50:19 +03:00
c080f52cea
move embedding logic to separate file
2022-10-11 19:37:58 +01:00
d4ea5f4d86
add an option to unload models during hypernetwork training to save VRAM
2022-10-11 19:03:08 +03:00
6d09b8d1df
produce error when training with medvram/lowvram enabled
2022-10-11 18:33:57 +03:00
4f96ffd0b5
Merge pull request #2201 from alg-wiki/textual__inversion
...
Textual Inversion: Preprocess and Training will only pick-up image files instead
2022-10-11 17:25:36 +03:00
1eaad95533
Merge branch 'master' into embed-embeddings-in-images
2022-10-11 15:15:09 +01:00
530103b586
fixes related to merge
2022-10-11 14:53:02 +03:00
8bacbca0a1
Removed my local edits to checkpoint image generation
2022-10-11 17:35:09 +09:00
b2368a3bce
Switched to exception handling
2022-10-11 17:32:46 +09:00
5de806184f
Merge branch 'master' into hypernetwork-training
2022-10-11 11:14:36 +03:00
7aa8fcac1e
use simple lcg in xor
2022-10-11 04:17:36 +01:00
bb932dbf9f
added alpha sort and threshold variables to create process method in preprocessing
2022-10-10 18:37:52 -05:00
47f5e216da
Merge branch 'deepdanbooru_pre_process' into master
2022-10-10 18:10:49 -05:00
e0fbe6d27e
colour depth conversion fix
2022-10-10 23:26:24 +01:00
767202a4c3
add dependency
2022-10-10 23:20:52 +01:00
315d5a8ed9
update data dis[play style
2022-10-10 23:14:44 +01:00
907a88b2d0
Added .webp .bmp
2022-10-11 06:35:07 +09:00
2536ecbb17
Refactored learning rate code
2022-10-10 17:10:29 -04:00
f0ab972f85
Merge branch 'master' into textual__inversion
2022-10-11 03:35:28 +08:00
bc3e183b73
Textual Inversion: Preprocess and Training will only pick-up image files
2022-10-11 04:30:13 +09:00
df6d0d9286
convert back to rgb as some hosts add alpha
2022-10-10 15:43:09 +01:00
707a431100
add pixel data footer
2022-10-10 15:34:49 +01:00
ce2d7f7eac
Merge branch 'master' into embed-embeddings-in-images
2022-10-10 15:13:48 +01:00
7a20f914ed
Custom Width and Height
2022-10-10 17:05:12 +03:00
6ad3a53e36
Fixed progress bar output for epoch
2022-10-10 17:05:12 +03:00
ea00c1624b
Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch
2022-10-10 17:05:12 +03:00
04c745ea4f
Custom Width and Height
2022-10-10 22:35:35 +09:00
4ee7519fc2
Fixed progress bar output for epoch
2022-10-10 17:31:33 +09:00
3110f895b2
Textual Inversion: Added custom training image size and number of repeats per input image in a single epoch
2022-10-10 17:07:46 +09:00
1f92336be7
refactored the deepbooru module to improve speed on running multiple interogations in a row. Added the option to generate deepbooru tags for textual inversion preproccessing.
2022-10-09 23:58:18 -05:00
e2c2925eb4
remove braces from steps
2022-10-10 00:12:53 +01:00
d6a599ef9b
change caption method
2022-10-10 00:07:52 +01:00
01fd9cf0d2
change source of step count
2022-10-09 22:17:02 +01:00
96f1e6be59
source checkpoint hash from current checkpoint
2022-10-09 22:14:50 +01:00
6684610510
correct case on embeddingFromB64
2022-10-09 22:06:42 +01:00
d0184b8f76
change json tensor key name
2022-10-09 22:06:12 +01:00
5d12ec82d3
add encoder and decoder classes
2022-10-09 22:05:09 +01:00
969bd8256e
add alternate checkpoint hash source
2022-10-09 22:02:28 +01:00
03694e1f99
add embedding load and save from b64 json
2022-10-09 21:58:14 +01:00
5841990b0d
Update textual_inversion.py
2022-10-09 05:38:38 +01:00
12c4d5c6b5
hypernetwork training mk1
2022-10-07 23:22:22 +03:00
4288e53fc2
removed unused import, fixed typo
2022-10-06 08:52:29 +03:00
2499fb4e19
Add sanitizer for captions in Textual inversion
2022-10-06 08:52:29 +03:00
5ef0baf5ea
add support for gelbooru tags in filenames for textual inversion
2022-10-04 08:52:27 +03:00
2865ef4b9a
fix broken date in TI
2022-10-03 13:10:03 +03:00
6785331e22
keep textual inversion dataset latents in CPU memory to save a bit of VRAM
2022-10-02 22:59:01 +03:00
c7543d4940
preprocessing for textual inversion added
2022-10-02 22:41:21 +03:00
a1cde7e646
disabled SD model download after multiple complaints
2022-10-02 21:09:10 +03:00
4ec4af6e0b
add checkpoint info to saved embeddings
2022-10-02 20:15:25 +03:00
71fe7fa49f
fix using aaaa-100 embedding when the prompt has aaaa-10000 and you have both aaaa-100 and aaaa-10000 in the directory with embeddings.
2022-10-02 19:56:37 +03:00
88ec0cf557
fix for incorrect embedding token length calculation (will break seeds that use embeddings, you're welcome!)
...
add option to input initialization text for embeddings
2022-10-02 19:40:51 +03:00
820f1dc96b
initial support for training textual inversion
2022-10-02 15:03:39 +03:00
DepFA