776edcf9d9
update cog doc
2024-03-13 18:38:55 -04:00
1cf110c6a5
fix caption cog plugin for image json reading
2024-03-13 18:26:13 -04:00
80a6672b41
title and tags plugin for caption on per image json file basis
2024-03-13 18:03:58 -04:00
d0a979ff9a
Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main
2024-03-03 16:55:42 -05:00
a90e13a926
cleaner viewing for grounding ui
2024-03-03 16:55:30 -05:00
d2f435eaf1
another minor caption doc update
2024-03-03 16:36:54 -05:00
bd0acb57fd
trying a cog colab notebook, and remove flamingo notebook since it is removed from repo
2024-03-03 16:36:54 -05:00
fdf230634e
Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main
2024-03-03 16:05:57 -05:00
2a76dd2009
clean up text on bounding box drawing of grounding ui
2024-03-03 16:05:50 -05:00
91a9b3d898
bugfix and doc fix
2024-03-03 15:47:44 -05:00
aca1867697
update caption docs and remove open flamingo script
2024-03-03 15:39:30 -05:00
3256f9e33c
add phrase grounding to kosmos2 caption script
2024-03-03 15:39:30 -05:00
a55ab816af
really dumb ui for looking at grounding files from kosmos2
2024-03-03 15:13:08 -05:00
8bab958c68
cog doc fix
2024-03-02 17:43:41 -05:00
7993143022
documentation for new cog stuff
2024-03-02 17:42:25 -05:00
42ad271261
bug in caption cog if starts_with no there
2024-03-02 01:58:13 -05:00
d098223052
merge conflict
2024-03-02 01:20:03 -05:00
be2cec7d3b
Update Train_Colab.ipynb
2024-02-23 11:33:09 -05:00
e1e070ca83
Cough... fixed typo
...
me not trying to be a grammar villian but a helpful noob
2024-02-06 18:11:20 +09:00
eee130d7dd
Fixs error when translated caption contains an unusual byte
...
fixs this
File "D:\EveryDream2trainer\caption_cog.py", line 143, in main
f.write(caption)
UnicodeEncodeError: 'cp949' codec can't encode character '\xe9' in position 333: illegal multibyte sequence
2024-02-06 17:49:21 +09:00
5622b55128
fix up cog caption script
2024-02-03 22:01:14 -05:00
1a8495a706
cleanup on cog caption script
2024-02-03 19:25:20 -05:00
cbc9a2d337
add cog-vlm to citations
2024-02-03 14:52:16 -05:00
f885be56a1
add cog caption script
2024-01-24 22:21:51 -05:00
18198715b7
Merge pull request #246 from damian0815/patch-2
...
prevent OOM with disabled unet when gradient checkpointing is enabled
2024-01-15 20:11:52 -05:00
9fc6ae7a09
prevent OOM with disabled unet when gradient checkpointing is enabled
...
unet needs to be in train() mode for gradient checkpointing to work
2024-01-16 10:23:52 +13:00
e08d5ded98
Merge pull request #245 from Enixile/main
...
BLIP2 and GIT updates
2024-01-10 13:47:08 -05:00
817f4169ce
BLIP2 was loading into system RAM rather than VRAM for me. I found that adding argument "device_map=device" forces it to load the entire model onto the specified device. I tested it for cuda and cpu successfully.
...
GIT was failing because its processor returns a BatchEncoding and its method to() only accepts one device parameter, so I removed the second dtype parameter and it worked. I don't see how BLIP2 is different, but it works with both parameters, so I left it to avoid breaking any functionality.
2024-01-06 15:16:59 -05:00
e8f7b6c8b4
fix oopsie
2023-12-22 13:54:20 -05:00
e89ec053c7
fix issue with plugin interaction with validation
2023-12-22 13:52:26 -05:00
9141710d6e
add ps activate script
2023-12-21 14:02:36 -05:00
c7d3064029
error in dataloader plugin
2023-12-21 10:50:11 -05:00
7a81182220
Update PLUGINS.md
...
update plugin docs
2023-12-20 16:46:44 -05:00
1119c2130f
Update PLUGINS.md
2023-12-20 15:39:57 -05:00
83623929ad
Update PLUGINS.md
...
add docs for dataloader plugin hooks
2023-12-20 15:29:33 -05:00
d9d2a43804
fix order of running pil image dataloader plugin
2023-12-20 15:24:09 -05:00
dfcc9e7f41
add dataloader plugin hooks for caption and pil image
2023-12-20 14:55:50 -05:00
1236329677
fix reshaping for picking apps
2023-11-29 22:17:52 -05:00
a05ffca82e
add positions id back for clip-l
2023-11-29 20:25:38 -05:00
49e382c82b
script to backdate autoencoderkl keys due to other broken software
2023-11-29 19:02:50 -05:00
3935a49730
removing open flamingo from standard installs and documenting, OF is broken in torch2.1 unfortunately
2023-11-26 12:51:58 -05:00
670354de94
removing open flamingo from requirements.txt
2023-11-26 12:33:04 -05:00
af49f3ce08
Merge pull request #243 from victorchall/attn
...
Add SDP attention and update windows to torch 2.1
2023-11-25 19:09:36 -05:00
8756eb9863
Merge branch 'attn' of https://github.com/victorchall/EveryDream2trainer into attn
2023-11-25 18:47:53 -05:00
ec98a79b1e
add tokenizer tester script
2023-11-25 17:21:34 -05:00
e705db29eb
doc for attn_type
2023-11-25 13:43:26 -05:00
a284c52dee
update windows to torch 2.1 and add attention type option
2023-11-24 16:13:01 -05:00
772d6bc439
Update ADVANCED_TWEAKING.md
2023-11-21 14:07:21 -05:00
051ecf57ad
Merge pull request #242 from a-l-e-x-d-s-9/main
...
New optimizer and pyramid noise
2023-11-21 14:02:58 -05:00
af74c7f5e1
jupyter notebook fix to upload ldm safetensors instead of ckpt
2023-11-18 13:33:22 -05:00
Victor Hall