EveryDream2trainer/README.md

91 lines
3.6 KiB
Markdown
Raw Permalink Normal View History

2022-12-17 20:32:48 -07:00
# EveryDream Trainer 2.0
Welcome to v2.0 of EveryDream trainer! Now with more Diffusers, faster, and even more features!
2022-12-17 22:43:25 -07:00
2023-03-18 22:59:17 -06:00
For the most up to date news and community discussions, please join us on Discord!
2022-12-17 20:32:48 -07:00
2023-03-18 22:59:17 -06:00
[![Discord!](.github/discord_sm.png)](https://discord.gg/uheqxU6sXN)
If you find this tool useful, please consider subscribing to the project on Patreon or a one-time donation on Ko-fi. Your donations keep this project alive as a free open source tool with ongoing enhancements.
[![Patreon](.github/patreon-medium-button.png)](https://www.patreon.com/everydream) or [![Kofi](.github/kofibutton_sm.png)](https://ko-fi.com/everydream).
2022-12-17 20:32:48 -07:00
If you're coming from Dreambooth, please [read this](doc/NOTDREAMBOOTH.md) for an explanation of why EveryDream is not Dreambooth.
2023-02-28 08:57:49 -07:00
## Requirements
Windows 10/11, Linux (Ubuntu 20.04+ recommended), or use the linux Docker container
2023-03-08 21:47:33 -07:00
2023-02-28 08:57:49 -07:00
Python 3.10.x
2023-03-08 21:47:33 -07:00
2023-02-28 08:57:49 -07:00
Nvidia GPU with 11GB VRAM or more (note: 1080 Ti and 2080 Ti may require compiling xformers yourself)
2023-03-08 21:47:33 -07:00
2023-02-28 08:57:49 -07:00
16GB system RAM recommended minimum
Single GPU is currently supported
2023-03-08 21:47:33 -07:00
2023-02-28 08:57:49 -07:00
32GB of system RAM recommended for 50k+ training images, but may get away with sufficient swap file and 16GB
2023-03-08 21:47:33 -07:00
2023-03-18 22:59:17 -06:00
Ampere or newer 24GB+ (3090/A5000/4090, etc) recommended for 10k+ images
2023-02-28 08:57:49 -07:00
2023-03-18 22:59:17 -06:00
...Or use any computer with a web browser and run on Vast/Colab. See [Cloud](#cloud) section below.
2023-02-28 08:57:49 -07:00
2022-12-18 15:21:13 -07:00
## Video tutorials
### [Basic setup and getting started](https://www.youtube.com/watch?v=OgpJK8SUW3c)
Covers install, setup of base models, startning training, basic tweaking, and looking at your logs
### [Multiaspect and crop jitter explainer](https://www.youtube.com/watch?v=0xswM8QYFD0)
2022-12-18 15:21:13 -07:00
Behind the scenes look at how the trainer handles multiaspect and crop jitter
2023-02-06 11:11:24 -07:00
### Companion tools repo
2023-01-17 10:44:18 -07:00
Make sure to check out the [tools repo](https://github.com/victorchall/EveryDream), it has a grab bag of scripts to help with your data curation prior to training. It has automatic bulk BLIP captioning for BLIP, script to web scrape based on Laion data files, script to rename generic pronouns to proper names or append artist tags to your captions, etc.
## Cloud/Docker
### [Free tier Google Colab notebook](https://colab.research.google.com/github/victorchall/EveryDream2trainer/blob/main/Train_Colab.ipynb)
### * [RunPod / Vast Instructions](/doc/CLOUD_SETUP.md)
#### * [Vast.ai Video Tutorial](https://www.youtube.com/watch?v=PKQesb4om9I)
#### [Runpod Video Tutorial](https://www.youtube.com/watch?v=XAULP-4hsnA)
### [Docker image link](https://github.com/victorchall/EveryDream2trainer/pkgs/container/everydream2trainer)
2022-12-17 20:32:48 -07:00
## Docs
[Setup and installation](doc/SETUP.md)
2022-12-18 15:21:13 -07:00
[Download and setup base models](doc/BASEMODELS.md)
2022-12-17 20:32:48 -07:00
[Data Preparation](doc/DATA.md)
[Training](doc/TRAINING.md) - How to start training
2022-12-17 20:32:48 -07:00
[Troubleshooting](doc/TROUBLESHOOTING.md)
2022-12-17 22:43:25 -07:00
[Basic Tweaking](doc/TWEAKING.md) - Important args to understand to get started
2023-01-08 16:52:39 -07:00
2023-04-14 01:12:44 -06:00
[Advanced Tweaking](doc/ADVANCED_TWEAKING.md) and [Advanced Optimizer Tweaking](/doc/OPTIMIZER.md)
2023-02-25 14:19:23 -07:00
[Chaining training sessions](doc/CHAINING.md) - Modify training parameters by chaining training sessions together end to end
[Shuffling Tags](doc/SHUFFLING_TAGS.md)
[Data Balancing](doc/BALANCING.md) - Includes my small treatise on model "preservation" with additional ground truth data
[Logging](doc/LOGGING.md)
2023-02-06 11:11:24 -07:00
2023-02-08 14:11:09 -07:00
[Validation](doc/VALIDATION.md) - Use a validation split on your data to see when you are overfitting and tune hyperparameters
2023-06-29 22:28:07 -06:00
[Captioning](doc/CAPTION.md) - (beta) tools to automate captioning
2023-07-04 15:36:57 -06:00
[Plugins](doc/PLUGINS.md) - (beta) write your own plugins to execute arbitrary code during training
[Contributing](doc/CONTRIBUTING.md)
2023-02-18 12:49:30 -07:00
[Citations and references](doc/CITATIONS.md)