Commit Graph

11 Commits

Author SHA1 Message Date
Augusto de la Torre 2bb35eaa0a Use filenames for caption if no main prompt in yaml 2023-04-14 00:59:26 +02:00
Augusto de la Torre cdafa2dc43 Avoid unnecessary iteration over files in folder 2023-03-21 12:09:52 +01:00
Augusto de la Torre 161e0a563c Prioritize tags, `image > local > global`, but respect weights 2023-03-21 00:15:53 +01:00
Augusto de la Torre fae0b3c535 Retain original tag order when parsing captions 2023-03-19 23:30:42 +01:00
Victor Hall 5afd75fd98 try-except around preloading items to help troubleshoot issues 2023-03-18 22:27:09 -04:00
Victor Hall f01a7354f0 remove sort from dataset due to slowdown on large sets, add contribution readme 2023-03-18 22:24:03 -04:00
Augusto de la Torre 48f132554c Assign default value for MAX_CAPTION_LENGTH 2023-03-15 21:52:32 +01:00
Victor Hall ba687de8b4 add pbar back to preloading, remove cruft from testing loss stuff 2023-03-15 12:06:29 -04:00
Augusto de la Torre 7e20a74586 Fix cond_dropout and rating handling 2023-03-13 00:36:59 +01:00
Augusto de la Torre dea8c6e862 Refactor dataset to support multiple main_prompts
...rather than multiple whole captions
2023-03-12 19:48:15 +01:00
Augusto de la Torre 0716c40ab6 Add support for enhanced dataset configuration
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00