Commit Graph

835 Commits

Author SHA1 Message Date
alexds9 32ee7cb7f0 Using -1.0 instead of -1. 2023-11-17 21:55:12 +02:00
Alex dcf2969640
Merge branch 'victorchall:main' into main 2023-11-17 20:52:34 +02:00
alexds9 fc6a4a7c27 LR removed from AdaCoor. 2023-11-17 20:52:15 +02:00
Victor Hall 31e1619a13 clean up citations 2023-11-17 13:39:12 -05:00
Victor Hall e3e542c121 add some citations and references links 2023-11-17 12:56:53 -05:00
Victor Hall d2dac6fd06 update requirements.txt to have newer xformers 2023-11-17 12:31:25 -05:00
Victor Hall 6727b6d61f fix log_writer bug and move logs into specific project log folder 2023-11-17 12:30:57 -05:00
alexds9 5dc9f18061 1. Added AdaCoor optimizer.
2. Added pyramid noise.
3. Fixed problem with log_writer missing from EveryDreamOptimizer.
2023-11-17 16:08:43 +02:00
Victor Hall bf3c022489 update docker tags 2023-11-16 12:04:39 -05:00
Victor Hall 840493037e gg bug from pr that thought it was simplifying code but broke it 2023-11-15 16:19:08 -05:00
Victor Hall 097d864ef5 fixing bugs 2023-11-15 15:57:09 -05:00
Victor Hall 20a9b3254f bug in optimizer decay-warmup defaulting 2023-11-15 15:46:28 -05:00
Victor Hall e95a8861e9 workaround for cuda errors on some rented machines 2023-11-15 14:45:43 -05:00
Victor Hall a95d2de150 fix ckpt to diffusers conversion script 2023-11-15 12:55:22 -05:00
Victor Hall b63ae0dafd
Merge pull request #238 from reijerh/patch-1
Quick edits to improve PLUGINS.md
2023-11-13 13:41:10 -05:00
Victor Hall 0b843718b8
Merge pull request #237 from reijerh/misc-minor-fixes
Misc minor fixes + minor improvements to txt2img script
2023-11-13 13:35:58 -05:00
Victor Hall 358dfbecd2
Merge pull request #240 from luisgabrielroldan/fix-device-mismatch-when-snr-used
Fix device mismatch when using min snr gamma option
2023-11-13 13:24:31 -05:00
Victor Hall 299af88f22 save as safetensors not ckpt 2023-11-13 13:12:42 -05:00
Gabriel Roldan b212b94d13
Fix device mismatch when using min snr gamma option 2023-11-13 12:17:56 -03:00
reijerh a53f19a048
Quick edits to improve PLUGINS.md
Mostly formatting and readability
2023-11-09 22:35:36 +01:00
reijerh 7de666ec2d Misc minor fixes 2023-11-09 00:22:41 +01:00
Victor Hall 6ea721887c allow scheduler change for training 2023-11-05 21:14:54 -05:00
Victor Hall 21361a3622 option to swap training scheduler 2023-11-05 20:54:14 -05:00
Victor Hall 4fae89fdee docker work 2023-11-05 20:54:14 -05:00
Victor Hall c0a1955164
Merge pull request #233 from damian0815/feat_the_acculmunator
plugin: grad accumulation scheduler
2023-11-05 19:53:11 -05:00
Victor Hall 3134fa1964
Merge pull request #236 from erichocean/erichocean-patch-1
Update CLOUD_SETUP.md
2023-11-05 19:52:06 -05:00
Victor Hall 9692031c27 work on docker 2023-11-05 19:33:44 -05:00
Erich Ocean d999c2fc1c
Update CLOUD_SETUP.md
Tell people that the secure cloud option for RunPod.io no longer works, and they must use the community cloud.
2023-11-05 18:49:12 -05:00
Victor Hall 45f41289db fix xf ver in dockerfile 2023-11-04 09:29:33 -04:00
Victor Hall 2bda841b2f
Merge pull request #232 from damian0815/feat_add_sde_samplers
Feat add sde samplers
2023-11-03 17:37:25 -04:00
Victor Hall 848b6eec71 fix balancing doc 2023-11-03 13:51:35 -04:00
Victor Hall 2512981956 remove errant print from kosmos script 2023-11-03 13:50:49 -04:00
Victor Hall 4c3de29d43 kosmos update and docs for loss_scale.txt 2023-11-03 13:50:49 -04:00
Victor Hall 30b063dfec
Merge pull request #235 from damian0815/feat_negative_loss
add loss_scale.txt
2023-11-03 13:36:36 -04:00
Victor Hall 164f635c6f dtype added for kosmos-2 captions 2023-11-02 23:24:00 -04:00
Victor Hall 24a692801a update kosmos2 caption to use cuda by default 2023-11-02 22:53:10 -04:00
Victor Hall 4fb64fed66 updating reqs 2023-11-02 21:54:33 -04:00
Victor Hall 3150f7d299 add kosmo-2 caption script and update diffusers and transformers to latest 2023-11-02 21:54:33 -04:00
Damian Stewart 86aaf1c4d7
fix big when loss_scale.txt contains 0 2023-11-01 19:00:08 +01:00
Damian Stewart c485d4ea60
fix device mismatch with loss_scale 2023-11-01 09:29:41 +01:00
Damian Stewart a7343ad190 fix scale batch calculation 2023-11-01 08:11:42 +01:00
Damian Stewart da731268b2 put a file loss_scale.txt containing a float in a training folder to apply loss scale (eg -1 for negative examples) 2023-10-31 10:06:21 +01:00
Damian Stewart bc1058a0d5
Merge branch 'victorchall:main' into feat_add_sde_samplers 2023-10-23 00:04:03 +02:00
Damian Stewart 380b2a54ca cleanup logging 2023-10-22 23:00:54 +02:00
Damian Stewart 69158fa51b fix distribution logic 2023-10-22 22:02:38 +02:00
Damian Stewart 20ce83d3e1 log curve 2023-10-22 21:41:20 +02:00
Damian Stewart 9a69ce84cb typo 2023-10-22 20:23:57 +02:00
Damian Stewart 6434844432 add missing json, fix error 2023-10-22 20:09:53 +02:00
Damian Stewart 9396d2156e Merge remote-tracking branch 'upstream/main' into feat_the_acculmunator 2023-10-22 19:35:32 +02:00
Damian Stewart 26a1475f0c initial implementation of the_acculmunator 2023-10-22 19:26:35 +02:00