Commit Graph

234 Commits

Author SHA1 Message Date
Victor Hall f275f20412 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2023-02-08 11:07:24 -05:00
Victor Hall b6f918daaf
Merge pull request #53 from damian0815/fix_validation_multiplier_logic
Fix multiplier issues with validation, and refactor validation logic
2023-02-08 11:06:46 -05:00
Victor Hall 5be15f0f16 remove doc for instant sample which was removed 2023-02-08 10:51:45 -05:00
Damian Stewart 19347bcaa8 make fractional multiplier logic apply per-directory 2023-02-08 14:15:54 +01:00
Damian Stewart a7b00e9ef3 fix multiplier logic 2023-02-08 13:46:58 +01:00
Damian Stewart 4e37200dda fix multiplier issues with validation and refactor validation logic 2023-02-08 11:28:45 +01:00
Victor Hall 1068d2dd2a
Merge pull request #52 from nawnie/patch-5
Xformer update
2023-02-07 22:59:57 -05:00
nawnie 94c2bc74a5
Xformer update
Prior version of Xformers is no longer available switching link to last stable release.

https://pypi.org/project/xformers/#history

Tested!
2023-02-07 21:50:39 -06:00
Victor Hall 7f6145098a
Merge pull request #48 from damian0815/feat_cli_args_override_json_file
CLI args override values in JSON file
2023-02-07 20:31:21 -05:00
Victor Hall 00ae25ae60
Merge branch 'main' into feat_cli_args_override_json_file 2023-02-07 20:31:01 -05:00
Victor Hall 6f4bfdc557 temporarily disable val, issues 2023-02-07 18:43:16 -05:00
Victor Hall 165525a71c
Merge pull request #50 from noprompt/add-support-for-val-split
Add support for validation split
2023-02-07 18:16:34 -05:00
Victor Hall defc6a9723 fix colab xformers install 2023-02-07 15:00:20 -05:00
Joel Holdbrooks fc79413224
Merge pull request #1 from damian0815/add-support-for-val-split
update & cleanup EveryDreamValidator
2023-02-07 10:53:13 -08:00
damian bca1e6e594 consistent spelling 2023-02-07 18:21:05 +01:00
damian e2d9600e34 cleaner config handling 2023-02-07 18:18:21 +01:00
damian dad9e347ff log ed batch name on creation 2023-02-07 18:08:19 +01:00
damian f0d7310c12 clarify init function names 2023-02-07 17:54:00 +01:00
damian c3d844a1bc better config handling 2023-02-07 17:52:23 +01:00
damian 29396ec21b update EveryDreamValidator for noprompt's changes 2023-02-07 17:46:30 +01:00
Damian Stewart e0ca75cc96 remove redundant update_old_args() function 2023-02-07 13:46:19 +01:00
Joel Holdbrooks 41c9f36ed7 GH-36: Add support for validation split (WIP)
Co-authored-by: Damian Stewart <office@damianstewart.com>
2023-02-06 22:10:34 -08:00
Victor Hall 85f19b9a2f doc and bug with undersized 2023-02-06 13:11:24 -05:00
Victor Hall 3b085bdd28
Merge pull request #39 from damian0815/feat_async_image_load
Enable multi-threaded image loading for a massive perf boost
2023-02-06 13:10:34 -05:00
Damian Stewart 21a64c38f2 move collate_fn to top level to possibly fix windows issue 2023-02-06 19:03:33 +01:00
Damian Stewart c270dbf6a8 ensure dataloader workers exit cleanly on ctrl-c 2023-02-06 19:03:33 +01:00
Damian Stewart 4b5654452c more workers 2023-02-06 19:03:33 +01:00
Damian Stewart 86a5004098 better main-thread detection 2023-02-06 19:03:33 +01:00
Damian Stewart 50a71e63b6 background load images for a 40% performance improvement 2023-02-06 19:03:33 +01:00
Damian Stewart 927880e1fc allow cli args to override config values 2023-02-06 08:16:08 +01:00
Victor Hall d99b3b1d9b
Merge pull request #38 from noprompt/push-dlma-into-main
Push DLMA into `main`, improvements to `data.resolve`
2023-02-05 08:20:10 -05:00
Victor Hall 581396ac0e
Merge pull request #42 from nawnie/patch-4
Update Train_Colab.ipynb
2023-02-04 19:40:46 -05:00
Victor Hall 4cb6990ac3
Merge pull request #41 from nawnie/patch-3
Bug Squashed
2023-02-04 19:39:56 -05:00
Victor Hall 49bc721673
Merge pull request #45 from qslug/runpod
Build working version of xformers for A5000/3090s
2023-02-04 19:39:03 -05:00
Augusto de la Torre 106f208fa6 Build working version of xformers for A5000/3090s 2023-02-03 00:10:38 +01:00
nawnie c936d9db48
Update Train_Colab.ipynb
xformers==0.0.17.dev435" is just the version i test can do just pip install xformers, but i did not test 0.0.16 yet, this mixed with the other pr's really speeds up colab
2023-02-01 00:42:11 -06:00
nawnie 377560204e
Bug Squashed
change "rated_dataset_target_dropout_rate:" to "rated_dataset_target_dropout_percent:"
2023-01-31 18:21:49 -06:00
Victor Hall 246b57c3c3
Merge pull request #37 from damian0815/feat_reload_sample_prompts_every_generation
re-read sample prompts txt file every generation
2023-01-31 11:07:08 -05:00
Joel Holdbrooks c8c658d181 Forgot to pass args to write_batch_schedule 2023-01-29 18:28:07 -08:00
Joel Holdbrooks f96d44ddb4 Move image resolution into its own function 2023-01-29 18:20:40 -08:00
Joel Holdbrooks 56f130c027 Forgot to add train.py earlier 🤦; move write_batch_schedule to train.py 2023-01-29 18:11:34 -08:00
Joel Holdbrooks 12a0cb6286 Update documentation 2023-01-29 17:58:42 -08:00
Joel Holdbrooks 3fe335f328 Update documentation 2023-01-29 17:47:10 -08:00
Joel Holdbrooks c0ec46c030 Don't need to set data loader singleton; formatting tweaks 2023-01-29 17:31:57 -08:00
Joel Holdbrooks 09d95fac58 Add test for list data resolver 2023-01-29 17:21:12 -08:00
Joel Holdbrooks 326d861a86 Push DLMA into main, pass config to resolve
This patch

* passes the configuration (`argparse.Namespace`) to the resolver,
* pushes the DLMA code into the main function,
* makes DLMA take a `list[ImageTrainItem]` instead of `data_root`,
* makes `EveryDreamBatch` take `DLMA` instead of `data_root`, etc.
* allows `data_root` to be a list.

By doing these things, both `EveryDreamBatch` and DLMA can be free from
data resolution logic. It also reduces the number of arguments which
need to be passed down to EDB and DLMA.
2023-01-29 17:08:54 -08:00
Damian Stewart 3aa9139b4b re-read sample prompts every time they're generated 2023-01-30 00:51:03 +01:00
Victor Hall bc273d0512 change training example to constant lr 2023-01-28 18:20:04 -05:00
Victor Hall 3df6dea29a update license for 2023 2023-01-27 13:59:02 -05:00
Victor Hall de80ae8912 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2023-01-27 13:58:25 -05:00