Mirrors
/
EveryDream2trainer
mirror of https://github.com/victorchall/EveryDream2trainer.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
507 Commits 6 Branches 0 Tags 5.4 MiB
Commit Graph

507 Commits

Author SHA1 Message Date
Damian Stewart a0fca99972 docs typo 2023-05-16 13:57:05 -04:00
Damian Stewart 1b432d8819 docs for TE freezing 2023-05-16 13:57:05 -04:00
Damian Stewart 85ad289296 update SD2.1 default training settings 2023-05-16 13:57:05 -04:00
Damian Stewart a6610625eb Squashed commit of the following: 
commit 0f890f2d6bbccee225f738934f4c4450323f19a2
Merge: c008c40 003b089
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 14 11:47:40 2023 +0200

    Merge remote-tracking branch 'upstream/main' into feat_te_last_n_layers_unsquashed

commit c008c404f19ebc6b78085f42a4e39aeb2ba00d04
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 14 11:23:20 2023 +0200

    finalize TE layer freezing

commit 7377b10d59e32a6fea5d321a598ae4504e1a9f36
Author: Damian Stewart <d@damianstewart.com>
Date:   Thu May 11 20:45:28 2023 +0200

    remove zero_lr method

commit 4af13ba816c2811d7b5bd6fbb81a32bca6747e99
Author: Damian Stewart <d@damianstewart.com>
Date:   Thu May 11 20:05:01 2023 +0200

    Revert "rename parameters"

    This reverts commit aa33c61337599ab2d90b34aaf8c3d36fd4edf147.

commit aa33c61337599ab2d90b34aaf8c3d36fd4edf147
Author: Damian Stewart <d@damianstewart.com>
Date:   Tue May 9 00:28:00 2023 +0200

    rename parameters

commit 1da867e6fadb873da2571371a73b522406d76a18
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 22:28:29 2023 +0200

    remove silly check

commit 483cb2a635c3fe5a044edf4ea8de095bedc3f0ac
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 20:53:43 2023 +0200

    use 1e-10 not 0 as 'zero' lr

commit e5d230e6c765a7e25dc6381d09bd0a66a9a54ec2
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 20:51:51 2023 +0200

    add experimental 'zero_lr' freeze method

commit bcf24ee59a443c0ee71d622e65e1043b547f845e
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 17:32:11 2023 +0200

    fix layer selection bug

commit 7ee33eff8740e095f85042dcbb792e025b179c6c
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 17:25:25 2023 +0200

    put back the 'drop' method and make accessible

commit 76dfbf6dd6f43f3aa9a7f4629baa8e86573d9520
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 16:39:05 2023 +0200

    wip getting final_layer_norm to work

commit a19d43651a87525251106ed57238cd2cd1c3f3ff
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 16:15:53 2023 +0200

    work around a crash when freeze_final_layer_norm is True

commit c2a44eb25132941b92e2ecd0be3682ae3c6838c2
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 15:47:10 2023 +0200

    improve logging, add extra freezing controls

commit a31e64c4c0d12dfb6583dd6f22c8c09ba7840410
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 13:46:38 2023 +0200

    alternative method to freeze early TE layers

commit 095692fd4ea53707c012217898321860d8b9329f
Merge: 876072c 4c5ce81
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 11:52:51 2023 +0200

    Merge branch 'victorchall:main' into feat_te_last_n_layers

commit 876072c46394fde721a6026f7a6ef72ccb150ddb
Author: Damian Stewart <d@damianstewart.com>
Date:   Sun May 7 01:41:50 2023 +0200

    implement last N layers training only for TE
 2023-05-16 13:57:05 -04:00
Colai 4a2e0bebdd fix typo 
example instead of exmaple
 2023-05-16 13:54:42 -04:00
Damian Stewart e14973a9da fix restoring optimizer state typo 2023-05-14 12:27:24 -04:00
Victor Hall 003b08992b remove old print 2023-05-11 19:17:19 -04:00
Victor Hall 9f2edb499d Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-05-08 18:25:43 -04:00
Victor Hall 6b8d66ee83 test reqs 2023-05-08 18:25:37 -04:00
Augusto de la Torre 98037d6006 Update LD_LIBRARY_PATH env on startup 
Export env variables explicitly for Vast.ai
 2023-05-08 15:16:19 -04:00
Victor Hall 6c562d5e78
Merge pull request #161 from damian0815/val_partial_epochs 
Feature: enable partial epoch support for validation
 2023-05-08 15:15:11 -04:00
Damian Stewart 8c05b7e1d5 update docs for every_n_epochs 2023-05-07 12:05:49 +02:00
Damian Stewart f3468fe7e7 Merge remote-tracking branch 'upstream/main' into val_partial_epochs 2023-05-07 02:11:58 +02:00
Victor Hall 4c5ce81b31
Update OPTIMIZER.md 2023-05-06 00:54:47 -04:00
Victor Hall cb511025ed finalizing optimizer split 2023-05-04 20:15:36 -04:00
Victor Hall 4e81a0eb55 optimizer split works 2023-05-04 20:15:36 -04:00
Victor Hall 970065c206 more wip optimizer splitting 2023-05-04 20:15:36 -04:00
Victor Hall 72a47741f0 optimizer spltting 2023-05-04 20:15:36 -04:00
Victor Hall 3639e36135 refactor optimizer to split te and unet 2023-05-04 20:15:36 -04:00
Victor Hall f0449c64e7 oops 2023-04-30 11:52:30 -04:00
Victor Hall 5e45cd22a0 remove amp from notebook, deprecated 2023-04-30 09:30:55 -04:00
Victor Hall 5d0b2ff24f remove notebook arg 2023-04-30 09:29:29 -04:00
Victor Hall 6340b7fdfe Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer 2023-04-29 18:15:40 -04:00
Victor Hall 29a19fd8b1 check if your git commit is out of date 2023-04-29 18:15:25 -04:00
damian 8e28a74386 add migration code for 2023-04-29 16:55:02 -04:00
damian 360eaa5a42 don't print, using logging 2023-04-29 16:55:02 -04:00
damian 413f981512 implement extra manual validation splits 2023-04-29 16:55:02 -04:00
Damian Stewart aad00eab2e switch up errored item logic flow 2023-04-29 13:03:10 -04:00
Damian Stewart ce85ce30ae warn on chronically underfilled aspect ratio buckets 2023-04-29 13:03:10 -04:00
Victor Hall 974d3fa53a
Merge pull request #151 from Alex-GZ/convert-order-fix 
Convert order fix
 2023-04-24 10:20:57 -04:00
Victor Hall 630ac5e46a
Merge pull request #152 from qslug/yaml-tag-str 
Always convert YAML tags to strings
 2023-04-22 19:03:04 -04:00
Victor Hall b7c7625051 unittest workflow fix maybe 2023-04-22 18:56:51 -04:00
Victor Hall f6a87eb327 github action for unit tests 2023-04-22 18:50:07 -04:00
Victor Hall 470c0aa040 github action for unit tests 2023-04-22 18:48:55 -04:00
Augusto de la Torre 2e8056174d Always convert YAML tags to strings 2023-04-23 00:36:32 +02:00
Alexander f431668cba forgot .items() 2023-04-20 17:08:19 +03:00
Alexander 8803d04cfe fixed weight conversion 2023-04-20 17:07:07 +03:00
Victor Hall a8520d6661 add compel to colab 2023-04-20 00:26:18 -04:00
Victor Hall 79886981a2
Merge pull request #148 from damian0815/fix_default_sd21_clipskip 
fix clip_skip default in trainSD21.json and update other params
 2023-04-19 13:32:11 -04:00
Damian Stewart c6f0465667 fix clip_skip default in trainSD21.json and update other params 2023-04-19 10:47:02 +02:00
Victor Hall bc7b95a375 update clip skip doc 2023-04-16 20:19:08 -04:00
Victor Hall 743c7cccae print args after cleaning, set attn slicing for sd15 if not using amp 2023-04-16 18:48:44 -04:00
Victor Hall e3e30a5599 fix exif issues 2023-04-16 14:53:34 -04:00
Victor Hall 3697b16344 put exif transpose back in preloading to fix bug 2023-04-16 02:19:27 -04:00
Victor Hall a5b22d85bd add license label to container 2023-04-15 19:03:39 -04:00
Victor Hall 9b6c01a7f0
Merge pull request #144 from victorchall/force 
try cache busting
 2023-04-15 16:55:30 -04:00
Victor Hall b0a6becf8a try cache busting 2023-04-15 16:39:51 -04:00
Victor Hall 77e4869e40
Merge pull request #142 from victorchall/force 
plz docker
 2023-04-15 14:35:50 -04:00
Victor Hall b716d11b8a plz docker 2023-04-15 14:35:15 -04:00
Victor Hall 1704bb93ce push docker image on push 2023-04-15 14:32:40 -04:00