Damian Stewart
|
53d0686086
|
add a batch_id.txt file to subfolders or a batch_id key to local yaml to force images for that folder to be processed in the same batch
|
2023-06-05 01:02:27 +02:00 |
|
Victor Hall
|
c0e7c4adf9
|
errant print
|
2023-06-01 19:23:43 -04:00 |
|
Victor Hall
|
615fa929e5
|
errant print
|
2023-06-01 19:17:43 -04:00 |
|
Victor Hall
|
56deb26a59
|
early work on shuffle_tags.txt and add try around trimming
|
2023-06-01 16:18:21 -04:00 |
|
Augusto de la Torre
|
2e8056174d
|
Always convert YAML tags to strings
|
2023-04-23 00:36:32 +02:00 |
|
Augusto de la Torre
|
2bb35eaa0a
|
Use filenames for caption if no main prompt in yaml
|
2023-04-14 00:59:26 +02:00 |
|
Augusto de la Torre
|
cdafa2dc43
|
Avoid unnecessary iteration over files in folder
|
2023-03-21 12:09:52 +01:00 |
|
Augusto de la Torre
|
161e0a563c
|
Prioritize tags, `image > local > global`, but respect weights
|
2023-03-21 00:15:53 +01:00 |
|
Augusto de la Torre
|
fae0b3c535
|
Retain original tag order when parsing captions
|
2023-03-19 23:30:42 +01:00 |
|
Victor Hall
|
5afd75fd98
|
try-except around preloading items to help troubleshoot issues
|
2023-03-18 22:27:09 -04:00 |
|
Victor Hall
|
f01a7354f0
|
remove sort from dataset due to slowdown on large sets, add contribution readme
|
2023-03-18 22:24:03 -04:00 |
|
Augusto de la Torre
|
48f132554c
|
Assign default value for MAX_CAPTION_LENGTH
|
2023-03-15 21:52:32 +01:00 |
|
Victor Hall
|
ba687de8b4
|
add pbar back to preloading, remove cruft from testing loss stuff
|
2023-03-15 12:06:29 -04:00 |
|
Augusto de la Torre
|
7e20a74586
|
Fix cond_dropout and rating handling
|
2023-03-13 00:36:59 +01:00 |
|
Augusto de la Torre
|
dea8c6e862
|
Refactor dataset to support multiple main_prompts
...rather than multiple whole captions
|
2023-03-12 19:48:15 +01:00 |
|
Augusto de la Torre
|
0716c40ab6
|
Add support for enhanced dataset configuration
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
|
2023-03-08 15:02:14 +01:00 |