Commit Graph

507 Commits

Author SHA1 Message Date
Damian Stewart 86a5004098 better main-thread detection 2023-02-06 19:03:33 +01:00
Damian Stewart 50a71e63b6 background load images for a 40% performance improvement 2023-02-06 19:03:33 +01:00
Damian Stewart 927880e1fc allow cli args to override config values 2023-02-06 08:16:08 +01:00
Victor Hall d99b3b1d9b
Merge pull request #38 from noprompt/push-dlma-into-main
Push DLMA into `main`, improvements to `data.resolve`
2023-02-05 08:20:10 -05:00
Victor Hall 581396ac0e
Merge pull request #42 from nawnie/patch-4
Update Train_Colab.ipynb
2023-02-04 19:40:46 -05:00
Victor Hall 4cb6990ac3
Merge pull request #41 from nawnie/patch-3
Bug Squashed
2023-02-04 19:39:56 -05:00
Victor Hall 49bc721673
Merge pull request #45 from qslug/runpod
Build working version of xformers for A5000/3090s
2023-02-04 19:39:03 -05:00
Augusto de la Torre 106f208fa6 Build working version of xformers for A5000/3090s 2023-02-03 00:10:38 +01:00
nawnie c936d9db48
Update Train_Colab.ipynb
xformers==0.0.17.dev435" is just the version i test can do just pip install xformers, but i did not test 0.0.16 yet, this mixed with the other pr's really speeds up colab
2023-02-01 00:42:11 -06:00
nawnie 377560204e
Bug Squashed
change "rated_dataset_target_dropout_rate:" to "rated_dataset_target_dropout_percent:"
2023-01-31 18:21:49 -06:00
Victor Hall 246b57c3c3
Merge pull request #37 from damian0815/feat_reload_sample_prompts_every_generation
re-read sample prompts txt file every generation
2023-01-31 11:07:08 -05:00
Joel Holdbrooks c8c658d181 Forgot to pass args to write_batch_schedule 2023-01-29 18:28:07 -08:00
Joel Holdbrooks f96d44ddb4 Move image resolution into its own function 2023-01-29 18:20:40 -08:00
Joel Holdbrooks 56f130c027 Forgot to add train.py earlier 🤦; move write_batch_schedule to train.py 2023-01-29 18:11:34 -08:00
Joel Holdbrooks 12a0cb6286 Update documentation 2023-01-29 17:58:42 -08:00
Joel Holdbrooks 3fe335f328 Update documentation 2023-01-29 17:47:10 -08:00
Joel Holdbrooks c0ec46c030 Don't need to set data loader singleton; formatting tweaks 2023-01-29 17:31:57 -08:00
Joel Holdbrooks 09d95fac58 Add test for list data resolver 2023-01-29 17:21:12 -08:00
Joel Holdbrooks 326d861a86 Push DLMA into main, pass config to resolve
This patch

* passes the configuration (`argparse.Namespace`) to the resolver,
* pushes the DLMA code into the main function,
* makes DLMA take a `list[ImageTrainItem]` instead of `data_root`,
* makes `EveryDreamBatch` take `DLMA` instead of `data_root`, etc.
* allows `data_root` to be a list.

By doing these things, both `EveryDreamBatch` and DLMA can be free from
data resolution logic. It also reduces the number of arguments which
need to be passed down to EDB and DLMA.
2023-01-29 17:08:54 -08:00
Damian Stewart 3aa9139b4b re-read sample prompts every time they're generated 2023-01-30 00:51:03 +01:00
Victor Hall bc273d0512 change training example to constant lr 2023-01-28 18:20:04 -05:00
Victor Hall 3df6dea29a update license for 2023 2023-01-27 13:59:02 -05:00
Victor Hall de80ae8912 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2023-01-27 13:58:25 -05:00
Victor Hall 9639237762 minor fix to multiply.txt stuff and undersized images txt output new line 2023-01-27 13:58:14 -05:00
Victor Hall 26f05d5eeb
Merge pull request #35 from nawnie/main
a100 xformer link
2023-01-27 07:58:59 -08:00
nawnie e7325d348a
Update Train_Colab.ipynb 2023-01-27 01:08:46 -06:00
nawnie 97797607b5
Xformer A100 link fix
added triton to install to remove error during run 
Xformer for a100 had the wrong link 
i left download for train_colab.py it is now gone
2023-01-26 22:10:11 -06:00
Victor Hall 98c8ab2976 fix wandb flag in colab causing issues 2023-01-26 16:14:23 -05:00
Victor Hall 5a86972287 Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2023-01-26 12:07:35 -05:00
Victor Hall 1e207677f3 sd21 example json config 2023-01-26 12:07:28 -05:00
Victor Hall 5ea6eb71fa
Merge pull request #13 from qslug/runpod
Add Notebook for Runpod
2023-01-26 05:19:11 -08:00
Augusto de la Torre 38d6f5350f
Remove other empty line 2023-01-26 12:17:29 +01:00
Augusto de la Torre ff10929645
Remove empty line 2023-01-26 12:17:09 +01:00
Augusto de la Torre 24cced0665
Merge branch 'main' into runpod 2023-01-26 12:16:08 +01:00
Victor Hall 5442eb6812
Merge pull request #30 from yunginnanet/patch-1
Update DATA.md
2023-01-25 21:51:36 -08:00
Victor Hall d9e31c719e cleanup instructions on colab notebok 2023-01-25 22:37:39 -05:00
Victor Hall 99900d4980 colab default tweaks and add wandb 2023-01-25 22:04:56 -05:00
Victor Hall b202198e3a fix notebook 2023-01-25 20:56:09 -05:00
Victor Hall 94feea99ee fix colab notebook 2023-01-25 20:55:24 -05:00
Victor Hall 9fe81c69f4
Merge pull request #32 from nawnie/patch-1
Delete train_colab.py
2023-01-25 10:37:19 -08:00
Victor Hall 9a9909c7ea
Merge pull request #33 from nawnie/patch-2
train.py
2023-01-25 10:36:50 -08:00
Victor Hall b4847d6f45
Merge pull request #31 from damian0815/patch-1
fix `'int' object is not callable` warning
2023-01-25 09:29:31 -08:00
nawnie e489e94d80
train.py
now works with colab and colab can use also make use of tqdm.auto so --notebook is unneeded
2023-01-25 04:12:30 -06:00
nawnie a2773dffbd
Delete train_colab.py
Obsolete
2023-01-25 04:09:29 -06:00
Damian Stewart 448848d5c2
fix `'int' object is not callable` warning 2023-01-25 11:06:52 +01:00
kayos 533353c104
Update DATA.md
Fix broken link
2023-01-24 18:49:35 -08:00
Victor Hall 09347779be
Merge pull request #29 from noprompt/refactor-follow-up
Refactor follow up
2023-01-24 09:39:45 -08:00
Joel Holdbrooks 94e9abf184 Don't bind resolver 2023-01-24 08:36:40 -08:00
Joel Holdbrooks a7505df0a6 Initialize target_wh to None 2023-01-24 08:33:40 -08:00
Joel Holdbrooks e6d1096637 Filter out items with errors 2023-01-24 08:33:20 -08:00