Commit Graph

811 Commits

Author SHA1 Message Date
Victor Hall 09347779be
Merge pull request #29 from noprompt/refactor-follow-up
Refactor follow up
2023-01-24 09:39:45 -08:00
Joel Holdbrooks 94e9abf184 Don't bind resolver 2023-01-24 08:36:40 -08:00
Joel Holdbrooks a7505df0a6 Initialize target_wh to None 2023-01-24 08:33:40 -08:00
Joel Holdbrooks e6d1096637 Filter out items with errors 2023-01-24 08:33:20 -08:00
Victor Hall f0e8ee55df
Merge pull request #28 from JanGerritsen/Bugfix_Adding_Tag_Twice
Bugfix: Adding same Tag twice to Caption
2023-01-24 07:12:56 -08:00
Jan Gerritsen 44fcbb6aa7 Bugfix: Adding same Tag twice to Caption 2023-01-24 16:02:12 +01:00
Victor Hall b9825a7077
Merge pull request #27 from damian0815/hf-download-docs
documentation for the huggingface automatic downloader
2023-01-24 06:42:37 -08:00
Damian Stewart 08d302b8b9 typo 2023-01-24 10:24:31 +01:00
Damian Stewart 6ba008e36b document the huggingface automatic downloader 2023-01-24 10:22:52 +01:00
Victor Hall 30d738c4ff
Merge pull request #26 from nawnie/main
Added a simple cell for Inference testing of diffusers
2023-01-23 20:48:30 -08:00
Victor Hall b3beb1c17b add wandb and mycfgs folders to gitignore 2023-01-23 23:39:57 -05:00
nawnie 062b993fa5 Created using Colaboratory 2023-01-23 21:03:48 -06:00
Victor Hall 2ba83cf0e4 remove unnecessary skip stuff 2023-01-23 20:47:12 -05:00
Victor Hall 4433bd7806
Merge pull request #19 from janekm/wandb_fix
Fix wandb setup
2023-01-23 17:38:49 -08:00
Victor Hall eea899f4a0
Merge pull request #24 from noprompt/refactor-data-resolution
Refactor data resolution
2023-01-23 17:38:27 -08:00
Joel Holdbrooks 7e2a7ae387 Need to yield from 2023-01-23 17:12:46 -08:00
Joel Holdbrooks c106de827c Fix name typo 2023-01-23 16:58:13 -08:00
Joel Holdbrooks 620b157e6a Fix some name errors 2023-01-23 16:57:02 -08:00
Augusto de la Torre 9bb213efaf Simplify example training 2023-01-24 01:12:56 +01:00
Augusto de la Torre 158dea22da Add Notebook for RunPod 2023-01-24 01:02:52 +01:00
Victor Hall 50b142f32a early iter on txt2img script for testing on remote instances 2023-01-23 16:51:00 -05:00
Victor Hall ac8bb6faab more docs, more docs, more docs, ok stop docs 2023-01-23 16:28:23 -05:00
Joel Holdbrooks e99a948d3c Fix property name bug 2023-01-23 12:52:53 -08:00
Victor Hall 8c9e7f1db8 more doc cleanup 2023-01-23 15:47:07 -05:00
Joel Holdbrooks 9491ae430c Initialize is_undersized to False, fix bug in directory resolver 2023-01-23 12:44:48 -08:00
Victor Hall 4a5ddd0cd1 more docs for new stuff 2023-01-23 15:35:25 -05:00
Joel Holdbrooks 685bada570 Update tests 2023-01-23 12:15:35 -08:00
Victor Hall 81599bb548
Merge pull request #12 from damian0815/hf_model_download
Enable download models from huggingface
2023-01-23 12:15:21 -08:00
Joel Holdbrooks d9081e8198 Use tqdm in JSONResolver, add a docstring 2023-01-23 12:11:42 -08:00
Damian Stewart 067ea506a2 check for local files before downloading from HF 2023-01-23 21:10:04 +01:00
Joel Holdbrooks 1a0b7994f4 Move target_wh calculation to ImageTrainItem 2023-01-23 12:00:42 -08:00
Joel Holdbrooks 1dfda8d6d4 Remove unused OptionalCallable alias 2023-01-23 11:28:11 -08:00
Joel Holdbrooks 646f383188 If there are no tags just return the main prompt 2023-01-23 11:27:12 -08:00
Joel Holdbrooks c1a66317cd Forgot to set prepared_train_data 2023-01-23 11:16:34 -08:00
Damian Stewart 6ee717c807 log a message on download 2023-01-23 19:45:23 +01:00
Damian Stewart 7a78ad0dfa prevent a crash if hf_repo_subfolder is unset 2023-01-23 19:38:47 +01:00
Damian Stewart 18fec68149 don't double-download data if safetensors files exist 2023-01-23 19:33:50 +01:00
Damian Stewart 4f3b4d7dda clarify code comments 2023-01-23 19:20:37 +01:00
Damian Stewart d24dd681c0 Merge remote-tracking branch 'upstream/main' into hf_model_download 2023-01-23 19:19:22 +01:00
Victor Hall d274ff2849 clarify what to resume from on colab notebook 2023-01-23 12:21:08 -05:00
Joel Holdbrooks b6c7299baf Merge branch 'main' into refactor-data-resolution 2023-01-23 08:43:23 -08:00
Joel Holdbrooks 993eabf99a Add static methods on ImageCaption for deriving captions from various sources 2023-01-23 08:22:44 -08:00
Joel Holdbrooks 316df2db7e Use data_resolver.resolve for data loading in data_loader 2023-01-23 00:15:32 -08:00
Joel Holdbrooks 0cf2cd71de Fix mistake in ImageCaption.parse 2023-01-23 00:14:50 -08:00
Joel Holdbrooks 4e6c5f4d00 Get rid of on_event callback 2023-01-22 23:58:25 -08:00
Joel Holdbrooks 9c6df69e4e Use DirectoryResolver.unzip_all 2023-01-22 23:14:16 -08:00
Joel Holdbrooks 08813eabb5 Use DirectoryResolver.recurse_data_root 2023-01-22 23:13:05 -08:00
Joel Holdbrooks aa0a2a1765 Sync recurse_data_root changes with data loader 2023-01-22 23:09:09 -08:00
Joel Holdbrooks 914a51b057 Add data.resolver module for training data resolution 2023-01-22 22:46:04 -08:00
Joel Holdbrooks 85b6aad6a9 If tags are empty, returne __main_prompt 2023-01-22 22:44:44 -08:00