0716c40ab6
Add support for enhanced dataset configuration
...
Add support for:
* flip_p.txt
* cond_dropout.txt
* local.yaml consolidated config (including default captions)
* global.yaml consolidated config which applies recursively to subfolders
* flip_p, and cond_dropout config per image
* manifest.json with full image-level configuration
2023-03-08 15:02:14 +01:00
e2fd45737d
overwrite args.seed with the actual seed if -1 is passed (so it appears in tensorboard)
...
also improve logging when unet training is disabled
2023-03-02 22:52:33 +01:00
4e37200dda
fix multiplier issues with validation and refactor validation logic
2023-02-08 11:28:45 +01:00
326d861a86
Push DLMA into main, pass config to resolve
...
This patch
* passes the configuration (`argparse.Namespace`) to the resolver,
* pushes the DLMA code into the main function,
* makes DLMA take a `list[ImageTrainItem]` instead of `data_root`,
* makes `EveryDreamBatch` take `DLMA` instead of `data_root`, etc.
* allows `data_root` to be a list.
By doing these things, both `EveryDreamBatch` and DLMA can be free from
data resolution logic. It also reduces the number of arguments which
need to be passed down to EDB and DLMA.
2023-01-29 17:08:54 -08:00
94e9abf184
Don't bind resolver
2023-01-24 08:36:40 -08:00
2ba83cf0e4
remove unnecessary skip stuff
2023-01-23 20:47:12 -05:00
7e2a7ae387
Need to yield from
2023-01-23 17:12:46 -08:00
c106de827c
Fix name typo
2023-01-23 16:58:13 -08:00
9491ae430c
Initialize is_undersized to False, fix bug in directory resolver
2023-01-23 12:44:48 -08:00
d9081e8198
Use tqdm in JSONResolver, add a docstring
2023-01-23 12:11:42 -08:00
1a0b7994f4
Move target_wh calculation to ImageTrainItem
2023-01-23 12:00:42 -08:00
1dfda8d6d4
Remove unused OptionalCallable alias
2023-01-23 11:28:11 -08:00
b6c7299baf
Merge branch 'main' into refactor-data-resolution
2023-01-23 08:43:23 -08:00
4e6c5f4d00
Get rid of on_event callback
2023-01-22 23:58:25 -08:00
aa0a2a1765
Sync recurse_data_root changes with data loader
2023-01-22 23:09:09 -08:00
914a51b057
Add data.resolver module for training data resolution
2023-01-22 22:46:04 -08:00
Augusto de la Torre