Victor Hall
|
6ea721887c
|
allow scheduler change for training
|
2023-11-05 21:14:54 -05:00 |
|
Victor Hall
|
21361a3622
|
option to swap training scheduler
|
2023-11-05 20:54:14 -05:00 |
|
Victor Hall
|
4fae89fdee
|
docker work
|
2023-11-05 20:54:14 -05:00 |
|
Victor Hall
|
c0a1955164
|
Merge pull request #233 from damian0815/feat_the_acculmunator
plugin: grad accumulation scheduler
|
2023-11-05 19:53:11 -05:00 |
|
Victor Hall
|
3134fa1964
|
Merge pull request #236 from erichocean/erichocean-patch-1
Update CLOUD_SETUP.md
|
2023-11-05 19:52:06 -05:00 |
|
Victor Hall
|
9692031c27
|
work on docker
|
2023-11-05 19:33:44 -05:00 |
|
Erich Ocean
|
d999c2fc1c
|
Update CLOUD_SETUP.md
Tell people that the secure cloud option for RunPod.io no longer works, and they must use the community cloud.
|
2023-11-05 18:49:12 -05:00 |
|
Victor Hall
|
45f41289db
|
fix xf ver in dockerfile
|
2023-11-04 09:29:33 -04:00 |
|
Victor Hall
|
2bda841b2f
|
Merge pull request #232 from damian0815/feat_add_sde_samplers
Feat add sde samplers
|
2023-11-03 17:37:25 -04:00 |
|
Victor Hall
|
848b6eec71
|
fix balancing doc
|
2023-11-03 13:51:35 -04:00 |
|
Victor Hall
|
2512981956
|
remove errant print from kosmos script
|
2023-11-03 13:50:49 -04:00 |
|
Victor Hall
|
4c3de29d43
|
kosmos update and docs for loss_scale.txt
|
2023-11-03 13:50:49 -04:00 |
|
Victor Hall
|
30b063dfec
|
Merge pull request #235 from damian0815/feat_negative_loss
add loss_scale.txt
|
2023-11-03 13:36:36 -04:00 |
|
Victor Hall
|
164f635c6f
|
dtype added for kosmos-2 captions
|
2023-11-02 23:24:00 -04:00 |
|
Victor Hall
|
24a692801a
|
update kosmos2 caption to use cuda by default
|
2023-11-02 22:53:10 -04:00 |
|
Victor Hall
|
4fb64fed66
|
updating reqs
|
2023-11-02 21:54:33 -04:00 |
|
Victor Hall
|
3150f7d299
|
add kosmo-2 caption script and update diffusers and transformers to latest
|
2023-11-02 21:54:33 -04:00 |
|
Damian Stewart
|
86aaf1c4d7
|
fix big when loss_scale.txt contains 0
|
2023-11-01 19:00:08 +01:00 |
|
Damian Stewart
|
c485d4ea60
|
fix device mismatch with loss_scale
|
2023-11-01 09:29:41 +01:00 |
|
Damian Stewart
|
a7343ad190
|
fix scale batch calculation
|
2023-11-01 08:11:42 +01:00 |
|
Damian Stewart
|
da731268b2
|
put a file loss_scale.txt containing a float in a training folder to apply loss scale (eg -1 for negative examples)
|
2023-10-31 10:06:21 +01:00 |
|
Damian Stewart
|
bc1058a0d5
|
Merge branch 'victorchall:main' into feat_add_sde_samplers
|
2023-10-23 00:04:03 +02:00 |
|
Damian Stewart
|
380b2a54ca
|
cleanup logging
|
2023-10-22 23:00:54 +02:00 |
|
Damian Stewart
|
69158fa51b
|
fix distribution logic
|
2023-10-22 22:02:38 +02:00 |
|
Damian Stewart
|
20ce83d3e1
|
log curve
|
2023-10-22 21:41:20 +02:00 |
|
Damian Stewart
|
9a69ce84cb
|
typo
|
2023-10-22 20:23:57 +02:00 |
|
Damian Stewart
|
6434844432
|
add missing json, fix error
|
2023-10-22 20:09:53 +02:00 |
|
Damian Stewart
|
9396d2156e
|
Merge remote-tracking branch 'upstream/main' into feat_the_acculmunator
|
2023-10-22 19:35:32 +02:00 |
|
Damian Stewart
|
26a1475f0c
|
initial implementation of the_acculmunator
|
2023-10-22 19:26:35 +02:00 |
|
Victor Hall
|
2f2dd4c1f2
|
Merge pull request #229 from luisgabrielroldan/fix-undersize-warning
Fix Inaccuracies in Image Size Validation and Warning Display
|
2023-10-07 15:25:25 -04:00 |
|
Victor Hall
|
387616083c
|
Merge pull request #228 from luisgabrielroldan/fix-save-ckpt-dir
Fix save_ckpt_dir not being honored when saving model
|
2023-10-07 14:34:52 -04:00 |
|
Victor Hall
|
81807b6cab
|
Merge pull request #227 from timlawrenz/patch-1
Update CAPTION.md
|
2023-10-07 14:32:16 -04:00 |
|
Gabriel Roldán
|
60e10867bc
|
Fix undersize warning
|
2023-10-05 01:48:09 -03:00 |
|
Gabriel Roldán
|
f301677881
|
Fix save_ckpt_dir not being when saving model
|
2023-10-01 00:09:24 -03:00 |
|
Tim Lawrenz
|
8f9d23cf3b
|
Update CAPTION.md
minor typo
|
2023-09-27 08:17:01 -04:00 |
|
Victor Hall
|
e8e4f0c2ea
|
Merge pull request #214 from luisgabrielroldan/keep_tags
Add --keep_tags to keep first N tags fixed on shuffle
|
2023-09-25 13:10:21 -04:00 |
|
Victor Hall
|
85b5bcc6e4
|
Update Train_Colab.ipynb
|
2023-09-25 12:34:13 -04:00 |
|
Victor Hall
|
3a2485eac5
|
fix save_every_n_epoch bug in colab
|
2023-09-25 12:15:29 -04:00 |
|
Victor Hall
|
8064c29066
|
add safetensors to colab req
|
2023-09-25 12:01:35 -04:00 |
|
Victor Hall
|
9e820c8cce
|
doc for lion8bit and prodigy
|
2023-09-22 16:02:22 -04:00 |
|
Victor Hall
|
78a4c13c4c
|
add prodigyopt requirements
|
2023-09-22 13:46:25 -04:00 |
|
Victor Hall
|
5444abfd7b
|
finalize lion8bit and add prodigy
|
2023-09-22 12:15:32 -04:00 |
|
Victor Hall
|
a9c98f5866
|
bugged flag
|
2023-09-22 10:16:56 -04:00 |
|
Victor Hall
|
166c2e74e1
|
off by one on last epoch save
|
2023-09-21 21:29:36 -04:00 |
|
Victor Hall
|
ada6037463
|
add bnb lion8bit support
|
2023-09-21 13:48:40 -04:00 |
|
Victor Hall
|
a47d65799f
|
early work on pinned image tensor
|
2023-09-21 13:48:40 -04:00 |
|
Gabriel Roldan
|
f2d5a40f72
|
Add --keep_tags docs and fix some typos
|
2023-09-20 19:57:04 -03:00 |
|
Gabriel Roldan
|
99a0431d0f
|
Ignore negative keep_tags values
|
2023-09-20 19:53:31 -03:00 |
|
Gabriel Roldán
|
43984f2ad3
|
Add --keep_tags to keep first N tags fixed on shuffle
|
2023-09-20 19:53:30 -03:00 |
|
Victor Hall
|
6c8d15daab
|
Merge pull request #209 from damian0815/feat_rolling_save
Feature: Rolling save ckpt
|
2023-09-20 16:32:48 -04:00 |