Commit Graph

100 Commits

Author SHA1 Message Date
Victor Hall 9639237762 minor fix to multiply.txt stuff and undersized images txt output new line 2023-01-27 13:58:14 -05:00
Joel Holdbrooks 94e9abf184 Don't bind resolver 2023-01-24 08:36:40 -08:00
Joel Holdbrooks a7505df0a6 Initialize target_wh to None 2023-01-24 08:33:40 -08:00
Joel Holdbrooks e6d1096637 Filter out items with errors 2023-01-24 08:33:20 -08:00
Jan Gerritsen 44fcbb6aa7 Bugfix: Adding same Tag twice to Caption 2023-01-24 16:02:12 +01:00
Victor Hall 2ba83cf0e4 remove unnecessary skip stuff 2023-01-23 20:47:12 -05:00
Joel Holdbrooks 7e2a7ae387 Need to yield from 2023-01-23 17:12:46 -08:00
Joel Holdbrooks c106de827c Fix name typo 2023-01-23 16:58:13 -08:00
Joel Holdbrooks 620b157e6a Fix some name errors 2023-01-23 16:57:02 -08:00
Joel Holdbrooks e99a948d3c Fix property name bug 2023-01-23 12:52:53 -08:00
Joel Holdbrooks 9491ae430c Initialize is_undersized to False, fix bug in directory resolver 2023-01-23 12:44:48 -08:00
Joel Holdbrooks d9081e8198 Use tqdm in JSONResolver, add a docstring 2023-01-23 12:11:42 -08:00
Joel Holdbrooks 1a0b7994f4 Move target_wh calculation to ImageTrainItem 2023-01-23 12:00:42 -08:00
Joel Holdbrooks 1dfda8d6d4 Remove unused OptionalCallable alias 2023-01-23 11:28:11 -08:00
Joel Holdbrooks 646f383188 If there are no tags just return the main prompt 2023-01-23 11:27:12 -08:00
Joel Holdbrooks c1a66317cd Forgot to set prepared_train_data 2023-01-23 11:16:34 -08:00
Joel Holdbrooks b6c7299baf Merge branch 'main' into refactor-data-resolution 2023-01-23 08:43:23 -08:00
Joel Holdbrooks 993eabf99a Add static methods on ImageCaption for deriving captions from various sources 2023-01-23 08:22:44 -08:00
Joel Holdbrooks 316df2db7e Use data_resolver.resolve for data loading in data_loader 2023-01-23 00:15:32 -08:00
Joel Holdbrooks 0cf2cd71de Fix mistake in ImageCaption.parse 2023-01-23 00:14:50 -08:00
Joel Holdbrooks 4e6c5f4d00 Get rid of on_event callback 2023-01-22 23:58:25 -08:00
Joel Holdbrooks 9c6df69e4e Use DirectoryResolver.unzip_all 2023-01-22 23:14:16 -08:00
Joel Holdbrooks 08813eabb5 Use DirectoryResolver.recurse_data_root 2023-01-22 23:13:05 -08:00
Joel Holdbrooks aa0a2a1765 Sync recurse_data_root changes with data loader 2023-01-22 23:09:09 -08:00
Joel Holdbrooks 914a51b057 Add data.resolver module for training data resolution 2023-01-22 22:46:04 -08:00
Joel Holdbrooks 85b6aad6a9 If tags are empty, returne __main_prompt 2023-01-22 22:44:44 -08:00
Joel Holdbrooks a6cabe8d7d Add static methods to ImageCaption for deriving captions from various sources 2023-01-22 16:13:50 -08:00
Victor Hall 18d1da0459 bug fix and multiplytxt fraction stuff 2023-01-22 18:59:59 -05:00
Victor Hall 24b00ab35b add fractional support for multiply.txt 2023-01-22 01:15:50 -05:00
Victor Hall 36ece59660 better undersized log file 2023-01-20 16:23:56 -05:00
Victor Hall 1c2708dc63 few sanity checks and remove keyboard 2023-01-20 09:42:24 -05:00
Jan Gerritsen 711e263e24 Implemented system to train on a subset of the dataset, favouring higher rated images 2023-01-14 16:18:22 +01:00
Jan Gerritsen fb73c16515 Make file name extension check case insensitive, so .JPG or .PNG files will also be detected 2023-01-10 11:54:26 +01:00
Jan Gerritsen f47ceadcc7 Implemented an optimization for the shuffling if all tags have the same weight and added documentation. 2023-01-09 21:53:46 +01:00
Jan Gerritsen 3d2709ace9 Implemented loading captions from yaml file 2023-01-09 21:53:07 +01:00
Jan Gerritsen a3618409bc Support more control regarding caption tag shuffeling using yaml files 2023-01-09 21:53:07 +01:00
Victor Hall 3c921dbaa2 chaining and more lowers resolutions 2023-01-08 18:52:39 -05:00
Victor Hall 98f9a7302d shuffle tags arg 2023-01-06 19:12:52 -05:00
Victor Hall 65c5fd5ccb json driven args, update run batch compensation 2023-01-03 14:27:26 -05:00
Victor Hall 07125135a8 safer writing of batch schedule 2023-01-02 18:02:35 -05:00
Victor Hall 726eecc958 add 1088 and 1152 and 448 resolution support 2023-01-01 21:13:31 -05:00
Victor Hall 05817b1c6b add 1088 and 1152 resolution but for real this time 2023-01-01 16:16:44 -05:00
Victor Hall 08ffdbbfe3 add 1088 and 1152 resolution 2023-01-01 16:16:07 -05:00
Victor Hall b316684bdb bunch of updates, grad ckpting, no drop bucket, shuffle every epoch 2023-01-01 10:45:18 -05:00
Victor Hall 051116a7d9 add gpu id support 2022-12-29 21:11:06 -05:00
Victor Hall 4c53f2d55c various tweaks and bugfixes over holidays 2022-12-27 14:25:32 -05:00
Victor Hall 8904724135 fix some quality issues 2022-12-20 03:30:42 -05:00
Victor Hall ac6391ef87 save ever n epochs, update docs 2022-12-18 21:16:14 -05:00
Victor Hall aff2377209 docs, update setup 2022-12-18 13:03:44 -05:00
Victor Hall 179fd5395b hey look ed2 2022-12-17 22:32:48 -05:00