Commit Graph

821 Commits

Author SHA1 Message Date
Victor Hall c30530ac39 add exclude_keys option for from_image_json prompt plugin 2024-06-21 18:23:19 -04:00
Victor Hall b1b73838f0 add from_image_json caption plugin to add all metadata from image json to prompt 2024-06-21 15:27:19 -04:00
Victor Hall de651dc6fb doc and aider ignore 2024-06-18 18:24:23 -04:00
Victor Hall dcbd9d45a9 add kwargs to cog patch for compatibility with newer diffusers versions 2024-06-18 18:24:23 -04:00
Victor Hall 938fe5016d adding llava 1.6 2024-06-18 18:24:23 -04:00
Victor Hall 0a6aa4815e
Update README.md
fix discord inv link
2024-06-14 17:20:46 -04:00
Victor Hall b3a8a53f38 update docs 2024-06-09 11:51:03 -04:00
Victor Hall da60499728 adding some links to experimental results that are posted on discord 2024-06-09 02:10:35 -04:00
Victor Hall 3b06e9f651 doc for embedding perturbation 2024-06-09 02:03:31 -04:00
Victor Hall beec38726a update caption to work with cog2 and glm-9v, add embedding_perturbation 2024-06-09 01:26:23 -04:00
Victor Hall d96b9cc56e
Update TRAINING.md
update docs
2024-05-31 13:48:20 -04:00
Victor Hall e5e684b8f3 oops 2024-05-15 17:14:46 -04:00
Victor Hall e7201d87db add unicode cleanup to caption_cog and a few more llava cleanups 2024-05-15 14:23:01 -04:00
Victor Hall 1fe3d9f4e5 adding filters for llava 2024-05-06 01:07:19 -04:00
Victor Hall d29368eb85 doc for check images script 2024-05-05 20:52:54 -04:00
Victor Hall ad4ade7781 script to check images now also does exif transpose in case 2024-05-05 20:03:09 -04:00
Victor Hall d50e8a69b2 script to check images 2024-05-05 20:00:18 -04:00
Victor Hall 3d02fa146d add doc item for xtuner llava 2024-05-04 22:37:05 -04:00
Victor Hall fb1caf52a7 add llava captioning 2024-05-04 22:24:24 -04:00
Victor Hall 475205ed93
Update BASEMODELS.md 2024-04-28 12:25:21 -04:00
Victor Hall bf067ba04a
Update BASEMODELS.md 2024-04-28 12:24:58 -04:00
Victor Hall 3a6fe3b4a1 add huber loss, timestep clamping, slightly safer txt reading 2024-04-26 23:54:31 -04:00
Victor Hall f369e534eb update cog doc 2024-04-02 16:36:26 -04:00
Victor Hall 7ea9676da8 enhance cog caption script 2024-04-02 16:35:49 -04:00
Victor Hall 65bd7b3b92 update windows setup cmd 2024-04-01 14:51:33 -04:00
Victor Hall 45ecb11402 update cog doc with colab link 2024-03-24 10:02:38 -04:00
Victor Hall 87bfe652ce caption cog notebook2 2024-03-24 10:00:00 -04:00
Victor Hall 93659f3eb4 caption cog notebook 2024-03-24 09:30:23 -04:00
Victor Hall 056de840d0 some cleanup/updates to caption stuff 2024-03-22 13:27:01 -04:00
Victor Hall 273ce23c7c update windows setup 2024-03-22 13:17:27 -04:00
Victor Hall 2525b62569 add peft to docker 2024-03-22 12:43:09 -04:00
Victor Hall 3a219e2502 update docker to fix cog 2024-03-22 12:41:14 -04:00
Victor Hall 642a64d5dc generator 2024-03-15 00:20:37 -04:00
Victor Hall 17054c9d10 patch cog to fix issue with transformers 2024-03-15 00:18:55 -04:00
Victor Hall 212d73f127 tiny doc update 2024-03-13 18:45:59 -04:00
Victor Hall d2a7a25da7 update caption_cog.py, transformers, and add peft 2024-03-13 18:38:55 -04:00
Victor Hall 776edcf9d9 update cog doc 2024-03-13 18:38:55 -04:00
Victor Hall 1cf110c6a5 fix caption cog plugin for image json reading 2024-03-13 18:26:13 -04:00
Victor Hall 80a6672b41 title and tags plugin for caption on per image json file basis 2024-03-13 18:03:58 -04:00
Victor Hall d0a979ff9a Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2024-03-03 16:55:42 -05:00
Victor Hall a90e13a926 cleaner viewing for grounding ui 2024-03-03 16:55:30 -05:00
Victor Hall d2f435eaf1 another minor caption doc update 2024-03-03 16:36:54 -05:00
Victor Hall bd0acb57fd trying a cog colab notebook, and remove flamingo notebook since it is removed from repo 2024-03-03 16:36:54 -05:00
Victor Hall fdf230634e Merge branch 'main' of https://github.com/victorchall/EveryDream2trainer into main 2024-03-03 16:05:57 -05:00
Victor Hall 2a76dd2009 clean up text on bounding box drawing of grounding ui 2024-03-03 16:05:50 -05:00
Victor Hall 91a9b3d898 bugfix and doc fix 2024-03-03 15:47:44 -05:00
Victor Hall aca1867697 update caption docs and remove open flamingo script 2024-03-03 15:39:30 -05:00
Victor Hall 3256f9e33c add phrase grounding to kosmos2 caption script 2024-03-03 15:39:30 -05:00
Victor Hall a55ab816af really dumb ui for looking at grounding files from kosmos2 2024-03-03 15:13:08 -05:00
Victor Hall 8bab958c68 cog doc fix 2024-03-02 17:43:41 -05:00