Commit Graph

14 Commits

Author SHA1 Message Date
Damian Stewart 4e37200dda fix multiplier issues with validation and refactor validation logic 2023-02-08 11:28:45 +01:00
Joel Holdbrooks 326d861a86 Push DLMA into main, pass config to resolve
This patch

* passes the configuration (`argparse.Namespace`) to the resolver,
* pushes the DLMA code into the main function,
* makes DLMA take a `list[ImageTrainItem]` instead of `data_root`,
* makes `EveryDreamBatch` take `DLMA` instead of `data_root`, etc.
* allows `data_root` to be a list.

By doing these things, both `EveryDreamBatch` and DLMA can be free from
data resolution logic. It also reduces the number of arguments which
need to be passed down to EDB and DLMA.
2023-01-29 17:08:54 -08:00
Joel Holdbrooks 94e9abf184 Don't bind resolver 2023-01-24 08:36:40 -08:00
Victor Hall 2ba83cf0e4 remove unnecessary skip stuff 2023-01-23 20:47:12 -05:00
Joel Holdbrooks 7e2a7ae387 Need to yield from 2023-01-23 17:12:46 -08:00
Joel Holdbrooks c106de827c Fix name typo 2023-01-23 16:58:13 -08:00
Joel Holdbrooks 9491ae430c Initialize is_undersized to False, fix bug in directory resolver 2023-01-23 12:44:48 -08:00
Joel Holdbrooks d9081e8198 Use tqdm in JSONResolver, add a docstring 2023-01-23 12:11:42 -08:00
Joel Holdbrooks 1a0b7994f4 Move target_wh calculation to ImageTrainItem 2023-01-23 12:00:42 -08:00
Joel Holdbrooks 1dfda8d6d4 Remove unused OptionalCallable alias 2023-01-23 11:28:11 -08:00
Joel Holdbrooks b6c7299baf Merge branch 'main' into refactor-data-resolution 2023-01-23 08:43:23 -08:00
Joel Holdbrooks 4e6c5f4d00 Get rid of on_event callback 2023-01-22 23:58:25 -08:00
Joel Holdbrooks aa0a2a1765 Sync recurse_data_root changes with data loader 2023-01-22 23:09:09 -08:00
Joel Holdbrooks 914a51b057 Add data.resolver module for training data resolution 2023-01-22 22:46:04 -08:00