removing open flamingo from standard installs and documenting, OF is broken in torch2.1 unfortunately

This commit is contained in:
Victor Hall 2023-11-26 12:51:58 -05:00
parent 670354de94
commit 3935a49730
2 changed files with 2 additions and 4 deletions

View File

@ -2,6 +2,8 @@
## Open-Flamingo ## Open-Flamingo
#### Note: Open-Flamingo currently only works on Torch 2.0.1. If you want to use it, you will have to backdate your torch installation, which will break features in the trainer. I recommend making a separate environment for Open Flamingo captioning instead. You can run through normal install, then `pip install open-flamingo` in the separate envirment to back date torch and make that install open-flamingo only.
`python caption_fl.py --data_root input --min_new_tokens 20 --max_new_tokens 30 --num_beams 3 --model "openflamingo/OpenFlamingo-9B-vitl-mpt7b"` `python caption_fl.py --data_root input --min_new_tokens 20 --max_new_tokens 30 --num_beams 3 --model "openflamingo/OpenFlamingo-9B-vitl-mpt7b"`
This script uses two example image/caption pairs located in the `/example` folder to prime the system to caption, then captions the images in the input folder. It will save a `.txt` file of the same base filename with the caption in the same folder. This script uses two example image/caption pairs located in the `/example` folder to prime the system to caption, then captions the images in the input folder. It will save a `.txt` file of the same base filename with the caption in the same folder.

View File

@ -24,10 +24,6 @@ pip install dadaptation
pip install safetensors pip install safetensors
pip install prodigyopt pip install prodigyopt
pip install torchsde pip install torchsde
pip install --no-deps open-flamingo==2.0.1
pip install einops
pip install einops-exts
pip install open-clip-torch
python utils/get_yamls.py python utils/get_yamls.py
GOTO :eof GOTO :eof