From 3935a497304ede536624d54c2e2e9988dff4556a Mon Sep 17 00:00:00 2001 From: Victor Hall Date: Sun, 26 Nov 2023 12:51:58 -0500 Subject: [PATCH] removing open flamingo from standard installs and documenting, OF is broken in torch2.1 unfortunately --- doc/CAPTION.md | 2 ++ windows_setup.cmd | 4 ---- 2 files changed, 2 insertions(+), 4 deletions(-) diff --git a/doc/CAPTION.md b/doc/CAPTION.md index 584f165..840d3f9 100644 --- a/doc/CAPTION.md +++ b/doc/CAPTION.md @@ -2,6 +2,8 @@ ## Open-Flamingo +#### Note: Open-Flamingo currently only works on Torch 2.0.1. If you want to use it, you will have to backdate your torch installation, which will break features in the trainer. I recommend making a separate environment for Open Flamingo captioning instead. You can run through normal install, then `pip install open-flamingo` in the separate envirment to back date torch and make that install open-flamingo only. + `python caption_fl.py --data_root input --min_new_tokens 20 --max_new_tokens 30 --num_beams 3 --model "openflamingo/OpenFlamingo-9B-vitl-mpt7b"` This script uses two example image/caption pairs located in the `/example` folder to prime the system to caption, then captions the images in the input folder. It will save a `.txt` file of the same base filename with the caption in the same folder. diff --git a/windows_setup.cmd b/windows_setup.cmd index 80775a5..c8bd6b6 100644 --- a/windows_setup.cmd +++ b/windows_setup.cmd @@ -24,10 +24,6 @@ pip install dadaptation pip install safetensors pip install prodigyopt pip install torchsde -pip install --no-deps open-flamingo==2.0.1 -pip install einops -pip install einops-exts -pip install open-clip-torch python utils/get_yamls.py GOTO :eof