EveryDream2trainer

Commit Graph

Select branches

Hide Pull Requests

attn

bfonesix

main

plugins

pooledload

torch2

#1

#103

#106

#107

#108

#11

#110

#111

#112

#113

#114

#115

#116

#117

#118

#12

#123

#124

#126

#127

#129

#13

#130

#131

#132

#134

#136

#137

#14

#140

#141

#142

#143

#144

#148

#149

#150

#151

#152

#153

#154

#155

#156

#158

#159

#160

#161

#162

#164

#166

#167

#168

#170

#173

#175

#176

#177

#180

#183

#185

#188

#19

#190

#192

#193

#194

#196

#197

#198

#20

#204

#205

#205

#209

#21

#211

#212

#212

#214

#22

#22

#220

#224

#226

#227

#228

#229

#230

#231

#232

#233

#234

#235

#236

#237

#238

#24

#240

#241

#242

#243

#245

#246

#248

#249

#250

#26

#261

#265

#265

#266

#27

#28

#29

#30

#31

#32

#33

#34

#35

#36

#37

#38

#39

#41

#42

#45

#48

#49

#50

#51

#52

#53

#56

#57

#58

#59

#60

#61

#63

#64

#66

#67

#7

#72

#75

#77

#78

#8

#80

#81

#82

#83

#85

#86

#87

#88

#9

#92

#93

#96

#97

#98

d2bda52758

Merge 6994da3ac8 into 05cf8a8215 #265 woweenie 2024-12-18 19:00:33 -0500
05cf8a8215

Merge pull request #266 from scottshireman/patch-1 main Victor Hall 2024-12-18 15:26:45 -0500
dc756ce22a

Update sample_generator.py #266 scottshireman 2024-12-03 08:47:28 -0500
684849ca6e

Update ADVANCED_TWEAKING.md Victor Hall 2024-09-25 09:54:10 -0400
6994da3ac8

fix the wrong min snr gamma #265 woweenie 2024-09-03 20:40:10 +0200
15eb3d887f

Update docker-publish.yml Victor Hall 2024-08-24 16:08:37 -0400
d7a1a7154a

Update README.md Victor Hall 2024-08-04 11:42:14 -0400
20211f1951

Update CLOUD_SETUP.md Victor Hall 2024-07-16 10:18:52 -0400
5ad853929c

Update CLOUD_SETUP.md Victor Hall 2024-07-15 19:07:44 -0400
6d0c31908a

Update CLOUD_SETUP.md Victor Hall 2024-07-15 18:48:39 -0400
36e10e8545

Update CLOUD_SETUP.md Victor Hall 2024-07-15 12:04:38 -0400
bc1e3e7209 default to cogvlm Victor Hall 2024-07-04 13:07:48 -0400
e507065df2 oops Victor Hall 2024-06-22 19:34:54 -0400
9e24693527 remove old cog named caption script Victor Hall 2024-06-21 21:18:34 -0400
2705b65836 update docs for rearrangement of captioning scripts Victor Hall 2024-06-21 21:04:45 -0400
69a58e3d4c renaming old caption script to blipgit Victor Hall 2024-06-21 18:24:43 -0400
c30530ac39 add exclude_keys option for from_image_json prompt plugin Victor Hall 2024-06-21 18:23:19 -0400
b1b73838f0 add from_image_json caption plugin to add all metadata from image json to prompt Victor Hall 2024-06-21 15:27:19 -0400
de651dc6fb doc and aider ignore Victor Hall 2024-06-18 18:24:20 -0400
dcbd9d45a9 add kwargs to cog patch for compatibility with newer diffusers versions Victor Hall 2024-06-18 18:23:31 -0400
938fe5016d adding llava 1.6 Victor Hall 2024-06-10 15:49:31 -0400
aebbc78f82

Update caption_cog.py - Fix for optional model argument #261 Enixile 2024-06-17 22:19:11 -0400
0a6aa4815e

Update README.md Victor Hall 2024-06-14 17:20:46 -0400
b3a8a53f38 update docs Victor Hall 2024-06-09 11:51:03 -0400
da60499728 adding some links to experimental results that are posted on discord Victor Hall 2024-06-09 02:10:35 -0400
3b06e9f651 doc for embedding perturbation Victor Hall 2024-06-09 02:03:31 -0400
beec38726a update caption to work with cog2 and glm-9v, add embedding_perturbation Victor Hall 2024-06-09 01:25:23 -0400
d96b9cc56e

Update TRAINING.md Victor Hall 2024-05-31 13:48:20 -0400
e5e684b8f3 oops Victor Hall 2024-05-15 17:14:46 -0400
e7201d87db add unicode cleanup to caption_cog and a few more llava cleanups Victor Hall 2024-05-15 14:23:01 -0400
1fe3d9f4e5 adding filters for llava Victor Hall 2024-05-06 01:07:19 -0400
d29368eb85 doc for check images script Victor Hall 2024-05-05 20:52:54 -0400
ad4ade7781 script to check images now also does exif transpose in case Victor Hall 2024-05-05 20:03:09 -0400
d50e8a69b2 script to check images Victor Hall 2024-05-05 20:00:18 -0400
3d02fa146d add doc item for xtuner llava Victor Hall 2024-05-04 22:37:05 -0400
fb1caf52a7 add llava captioning Victor Hall 2024-05-04 22:24:17 -0400
475205ed93

Update BASEMODELS.md Victor Hall 2024-04-28 12:25:21 -0400
bf067ba04a

Update BASEMODELS.md Victor Hall 2024-04-28 12:24:58 -0400
3a6fe3b4a1 add huber loss, timestep clamping, slightly safer txt reading Victor Hall 2024-04-26 23:54:31 -0400
f369e534eb update cog doc Victor Hall 2024-04-02 16:36:26 -0400
7ea9676da8 enhance cog caption script Victor Hall 2024-04-02 16:35:49 -0400
65bd7b3b92 update windows setup cmd Victor Hall 2024-04-01 14:51:33 -0400
45ecb11402 update cog doc with colab link Victor Hall 2024-03-24 10:02:38 -0400
87bfe652ce caption cog notebook2 Victor Hall 2024-03-24 10:00:00 -0400
93659f3eb4 caption cog notebook Victor Hall 2024-03-24 09:30:23 -0400
056de840d0 some cleanup/updates to caption stuff Victor Hall 2024-03-22 13:27:01 -0400
273ce23c7c update windows setup Victor Hall 2024-03-22 13:17:27 -0400
2525b62569 add peft to docker Victor Hall 2024-03-22 12:43:09 -0400
3a219e2502 update docker to fix cog Victor Hall 2024-03-22 12:41:14 -0400
642a64d5dc generator Victor Hall 2024-03-15 00:20:37 -0400
17054c9d10 patch cog to fix issue with transformers Victor Hall 2024-03-15 00:18:55 -0400
212d73f127 tiny doc update Victor Hall 2024-03-13 18:45:59 -0400
d2a7a25da7 update caption_cog.py, transformers, and add peft Victor Hall 2024-03-13 18:38:30 -0400
776edcf9d9 update cog doc Victor Hall 2024-03-13 18:31:52 -0400
1cf110c6a5 fix caption cog plugin for image json reading Victor Hall 2024-03-13 18:26:13 -0400
80a6672b41 title and tags plugin for caption on per image json file basis Victor Hall 2024-03-13 18:03:58 -0400
d0a979ff9a Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main Victor Hall 2024-03-03 16:55:42 -0500
a90e13a926 cleaner viewing for grounding ui Victor Hall 2024-03-03 16:55:30 -0500
d2f435eaf1 another minor caption doc update Victor Hall 2024-03-03 16:36:50 -0500
bd0acb57fd trying a cog colab notebook, and remove flamingo notebook since it is removed from repo Victor Hall 2024-03-03 16:13:58 -0500
fdf230634e Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main Victor Hall 2024-03-03 16:05:57 -0500
2a76dd2009 clean up text on bounding box drawing of grounding ui Victor Hall 2024-03-03 16:05:50 -0500
91a9b3d898 bugfix and doc fix Victor Hall 2024-03-03 15:47:44 -0500
aca1867697 update caption docs and remove open flamingo script Victor Hall 2024-03-03 15:39:25 -0500
3256f9e33c add phrase grounding to kosmos2 caption script Victor Hall 2024-03-03 15:18:54 -0500
a55ab816af really dumb ui for looking at grounding files from kosmos2 Victor Hall 2024-03-03 15:13:08 -0500
8bab958c68 cog doc fix Victor Hall 2024-03-02 17:43:41 -0500
7993143022 documentation for new cog stuff Victor Hall 2024-03-02 17:42:25 -0500
42ad271261 bug in caption cog if starts_with no there Victor Hall 2024-03-02 01:58:13 -0500
d098223052 merge conflict Victor Hall 2024-03-02 01:20:03 -0500
be2cec7d3b

Update Train_Colab.ipynb Victor Hall 2024-02-23 11:33:09 -0500
b509f94488 Added MAX_IMAGE_PIXELS=None #250 BlueBug 2024-02-08 19:44:27 +0900
e1e070ca83 Cough... fixed typo #249 BlueBug 2024-02-06 18:11:20 +0900
eee130d7dd Fixs error when translated caption contains an unusual byte BlueBug 2024-02-06 17:49:21 +0900
5622b55128 fix up cog caption script Victor Hall 2024-02-03 22:01:14 -0500
1a8495a706 cleanup on cog caption script Victor Hall 2024-02-03 19:24:59 -0500
cbc9a2d337

add cog-vlm to citations Victor Hall 2024-02-03 14:52:16 -0500
f885be56a1 add cog caption script Victor Hall 2024-01-24 22:21:06 -0500
1a4ac2d339 add TextualInversionLoaderPlugin #248 Damian Stewart 2024-01-24 21:45:46 +1300
072c2a695a fix missing base method for on_backpropagation Damian Stewart 2024-01-22 21:01:55 +1300
0dcf0e8c36 add missing base plugin defs and fix docs Damian Stewart 2024-01-22 11:02:01 +1300
1cb8ff2ed8 fix example Damian Stewart 2024-01-20 02:00:04 +1300
6205f7a574 actually pass through the plugin_runner Damian Stewart 2024-01-19 22:40:33 +1300
635e04fe05 add modify_sample_prompt plugin callback Damian Stewart 2024-01-19 18:46:39 +1300
0a3259ae5b don't clobber trained embeddings when resuming Damian Stewart 2024-01-19 16:34:13 +1300
18198715b7

Merge pull request #246 from damian0815/patch-2 Victor Hall 2024-01-15 20:11:52 -0500
a7f3b0a146 zero non-training embedding grads in the correct place Damian Stewart 2024-01-16 11:20:37 +1300
9fc6ae7a09

prevent OOM with disabled unet when gradient checkpointing is enabled #246 Damian Stewart 2024-01-16 10:23:52 +1300
bf5b03205e fix saving, more strict config check Damian Stewart 2024-01-15 21:08:12 +1300
e90d163571 fix issues Damian Stewart 2024-01-15 19:23:52 +1300
4ff972c67c ti >1 vector lenght support (untested) Damian Stewart 2024-01-15 18:47:00 +1300
e08d5ded98

Merge pull request #245 from Enixile/main Victor Hall 2024-01-10 13:47:08 -0500
df4647e4ab wip long vector length Damian Stewart 2024-01-08 20:00:39 +1300
3840e4811a zero the grads rather than resetting the weights Damian Stewart 2024-01-07 21:08:52 +1300
ff4d93ab48 zero the grads rather than resetting the weights #231 Damian Stewart 2024-01-07 21:08:52 +1300
817f4169ce BLIP2 was loading into system RAM rather than VRAM for me. I found that adding argument "device_map=device" forces it to load the entire model onto the specified device. I tested it for cuda and cpu successfully. #245 Enixile 2024-01-06 15:16:59 -0500
e8f7b6c8b4 fix oopsie Victor Hall 2023-12-22 13:54:20 -0500
e89ec053c7 fix issue with plugin interaction with validation Victor Hall 2023-12-22 13:52:26 -0500
9141710d6e add ps activate script Victor Hall 2023-12-21 14:02:36 -0500
c7d3064029 error in dataloader plugin Victor Hall 2023-12-21 10:49:06 -0500