Commit Graph

193 Commits

Author SHA1 Message Date
Anthony Mercurio 1ea31eb71e
Merge pull request #31 from john-sungjin/fix-ema-checkpoint-saving
Restore non-EMA weights after saving checkpoint
2022-11-06 16:44:11 -08:00
John Kim 94603d9578 Added store/restore to EMAModel, restore non-EMA weights after saving checkpoint 2022-11-07 00:28:55 +00:00
Anthony Mercurio 517f3e154f
Merge pull request #30 from harubaru/scheduler-options
Updates to Scheduler Options and Resume Code
2022-11-06 07:51:48 -08:00
cafeai 2048ce67ef Remove Unnecessary Line (Scheduler) 2022-11-06 19:34:33 +09:00
cafeai b303fdc293 Scheduler Options & Resume Updates 2022-11-06 19:08:38 +09:00
Anthony Mercurio 56923359a3
Add checkpoint resuming, exception handling, and learning rate schedulers 2022-11-06 01:05:40 -07:00
Anthony Mercurio 2321e22fc1
Merge pull request #28 from AstraliteHeart/main
Misc cleanups from pony-diffusion test run
2022-11-05 08:55:48 -07:00
Anthony Mercurio 7be7fc3b98
Merge branch 'main' into main 2022-11-05 08:55:29 -07:00
Anthony Mercurio 5b793feb52
Merge pull request #29 from harubaru/bucket-tests
Bucket tests
2022-11-05 08:54:26 -07:00
cafeai ed35788059 Cleanup 2022-11-06 00:53:30 +09:00
cafeai b0b1337bc5 ImageStore Filename Fix 2022-11-06 00:32:15 +09:00
cafeai 305efa20f2 Bucket Helpers 2022-11-05 22:55:56 +09:00
Astralite Heart 0e0acf31b1 diffusers no longer use tensor_format in DDPMScheduler 2022-11-05 11:05:45 +00:00
Astralite Heart 74ef98667c Add bitsandbytes instructions 2022-11-05 10:38:35 +00:00
Astralite Heart bb153c1ec0 Add missing reqs / fix versions 2022-11-04 17:31:08 -07:00
Anthony Mercurio 6b73cfe448
Add CLIP penultimate layer for diffusers trainer 2022-11-02 16:20:46 -07:00
Anthony Mercurio 1a94c70736
Implement distributed training 2022-11-01 13:28:12 -07:00
Anthony Mercurio ef25ccac36
add vae config 2022-11-01 12:40:39 -07:00
Anthony Mercurio 6bf942eb63
Merge pull request #26 from GripenANM/Update-Weights-Readme.md-to-v1.3-model
Update Weights Readme.md to v1.3 model
2022-10-29 18:58:56 -07:00
Anthony Mercurio 8247915345
add attribution 2022-10-29 16:11:48 -07:00
Anthony Mercurio be702cce2e
Aspect ratio bucketing, Training overhaul, more new stuff 2022-10-29 09:26:03 -07:00
Akumi Chan e1e416a5b9
Removed Huggingface metadata table 2022-10-25 13:31:22 -07:00
Akumi Chan 1947519397
Update Weights Readme.md to v1.3 model
cloned huggingface model card
2022-10-25 13:23:18 -07:00
harubaru 76efa00de3 fix deprecation warnings in dataloader 2022-10-15 18:43:28 -07:00
harubaru 67140231e7 fix inference config 2022-10-15 11:41:39 -07:00
harubaru 61ed683d1c ensure wandb run doesnt get overwritten 2022-10-15 11:40:53 -07:00
harubaru 18ad704fd6 fix wandb logging 2022-10-15 11:20:32 -07:00
harubaru f980137430 add fp16 training 2022-10-15 10:57:00 -07:00
harubaru 9581fbc226
Merge pull request #24 from hasuwoof/feature/extended_clip
Implement CLIP extensions (training + inference)
2022-10-14 16:27:21 -07:00
hasuwoof 60c04259fa Implement CLIP extensions (training + inference) 2022-10-14 19:31:53 +01:00
harubaru 0afe73cf0e
Merge pull request #21 from eltociear/patch-2
Fix typo in ddpm.py
2022-10-14 03:46:39 -07:00
Ikko Ashimine 8b0f40809e
Fix typo in ddpm.py
postions -> positions
2022-10-14 12:14:25 +09:00
harubaru c4d8e967e9 oops forgot layer norm
this is probably why i was getting garbage in training
2022-10-13 01:39:01 -07:00
harubaru adbbc73e19 fix hidden states 2022-10-12 18:48:22 -07:00
harubaru f8bfa5f357 fix config 2022-10-12 18:32:51 -07:00
harubaru 169b63e179 add unconditional guidance training 2022-10-12 18:28:44 -07:00
harubaru 4f9070af3c use penultimate layer
from NAI blogpost and https://arxiv.org/pdf/2205.11487.pdf
2022-10-12 17:55:56 -07:00
harubaru e4736c11f5 add initial config 2022-10-12 17:45:44 -07:00
harubaru a4628125fe
fix pruning script yet again 2022-09-27 19:50:55 -07:00
harubaru aa91eaf228
gotta go fast 2022-09-24 01:13:36 -07:00
harubaru ae05402bc6
speedup 2022-09-23 15:26:58 -07:00
harubaru de1470f43b fix downloader 2022-09-22 19:49:08 -07:00
harubaru d0ec5be718
add centercropping 2022-09-22 19:45:36 -07:00
harubaru 5b169173d5
fix config 2022-09-22 17:44:19 -07:00
harubaru c5f2775beb Add alternate dataloader 2022-09-22 14:56:27 -07:00
harubaru 2e69358d50 Add random tag order during training 2022-09-21 04:57:17 -07:00
harubaru b080f33115 Add variable aspect ratio during training 2022-09-21 04:47:39 -07:00
harubaru c690d005bc fix cropping 2022-09-20 22:24:04 -07:00
harubaru 01b9440d50 dataloader overhaul 2022-09-20 22:00:32 -07:00
harubaru 3546ae9b47 add 8 gpu config 2022-09-20 11:34:06 -07:00