You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
 
Go to file
Victor Hall e8e4f0c2ea
Merge pull request #214 from luisgabrielroldan/keep_tags
Add --keep_tags to keep first N tags fixed on shuffle
5 days ago
.devcontainer Split requirements between build and runtime 6 months ago
.github Update docker-publish.yml 3 months ago
cfgs update coco example cfg 7 months ago
data Merge pull request #214 from luisgabrielroldan/keep_tags 5 days ago
doc Merge pull request #214 from luisgabrielroldan/keep_tags 5 days ago
docker add prodigyopt requirements 1 week ago
examples flamingo 3 months ago
optimizer finalize lion8bit and add prodigy 1 week ago
plugins cleanup 2 weeks ago
scripts move img captio gui over to ed2 3 months ago
test shuffle named batches while respecting and accounting for grad_accum 4 months ago
utils 1. Samples format change to make sure global step appear before "ema" indication. 3 weeks ago
.gitignore Add docker compose file 4 months ago
.pylintrc gitignore 10 months ago
CaptionFL.ipynb set highmem and t4 for colab 3 months ago
LICENSE update license for 2023 8 months ago
LICENSE_AGPL update license for 2023 8 months ago
README.md add plugin doc link 3 months ago
Train_Colab.ipynb Update Train_Colab.ipynb 5 days ago
Train_JupyterLab.ipynb Update Train_JupyterLab.ipynb 4 months ago
activate_venv.bat hey look ed2 10 months ago
caption.py caption thing 6 months ago
caption_fl.py fix caption fl 3 months ago
chain.bat update ed1 mode 9 months ago
chain0.json chaining and more lowers resolutions 9 months ago
chain1.json chaining and more lowers resolutions 9 months ago
chain2.json chaining and more lowers resolutions 9 months ago
docker-compose.yml Add docker compose file 4 months ago
optimizer.json Merge branch 'main' into fix_simplify_freezing_text_encoder_layers 3 months ago
optimizerSD21.json simplify freezing text encoder layers config 3 months ago
optimizer_dadapt.json Update optimizer_dadapt.json 2 months ago
requirements-test.txt test reqs 5 months ago
requirements.txt Update requirements.txt 4 weeks ago
sample_prompts.json Update sample_prompts.json 7 months ago
sample_prompts.txt hey look ed2 10 months ago
train.json update ema sample args again 2 weeks ago
train.py Merge pull request #214 from luisgabrielroldan/keep_tags 5 days ago
trainSD21.json update ema sample args again 2 weeks ago
validation_default.json update docs for every_n_epochs 5 months ago
windows_setup.cmd add prodigyopt requirements 1 week ago

README.md

EveryDream Trainer 2.0

Welcome to v2.0 of EveryDream trainer! Now with more Diffusers, faster, and even more features!

For the most up to date news and community discussions, please join us on Discord!

Discord!

If you find this tool useful, please consider subscribing to the project on Patreon or a one-time donation on Ko-fi. Your donations keep this project alive as a free open source tool with ongoing enhancements.

Patreon or Kofi.

If you're coming from Dreambooth, please read this for an explanation of why EveryDream is not Dreambooth.

Requirements

Windows 10/11, Linux (Ubuntu 20.04+ recommended), or use the linux Docker container

Python 3.10.x

Nvidia GPU with 11GB VRAM or more (note: 1080 Ti and 2080 Ti may require compiling xformers yourself)

16GB system RAM recommended minimum

Single GPU is currently supported

32GB of system RAM recommended for 50k+ training images, but may get away with sufficient swap file and 16GB

Ampere or newer 24GB+ (3090/A5000/4090, etc) recommended for 10k+ images

...Or use any computer with a web browser and run on Vast/Colab. See Cloud section below.

Video tutorials

Basic setup and getting started

Covers install, setup of base models, startning training, basic tweaking, and looking at your logs

Multiaspect and crop jitter explainer

Behind the scenes look at how the trainer handles multiaspect and crop jitter

Companion tools repo

Make sure to check out the tools repo, it has a grab bag of scripts to help with your data curation prior to training. It has automatic bulk BLIP captioning for BLIP, script to web scrape based on Laion data files, script to rename generic pronouns to proper names or append artist tags to your captions, etc.

Cloud/Docker

Free tier Google Colab notebook

* RunPod / Vast Instructions

* Vast.ai Video Tutorial

Runpod Video Tutorial

Docs

Setup and installation

Download and setup base models

Data Preparation

Training - How to start training

Troubleshooting

Basic Tweaking - Important args to understand to get started

Advanced Tweaking and Advanced Optimizer Tweaking

Chaining training sessions - Modify training parameters by chaining training sessions together end to end

Shuffling Tags

Data Balancing - Includes my small treatise on model "preservation" with additional ground truth data

Logging

Validation - Use a validation split on your data to see when you are overfitting and tune hyperparameters

Captioning - (beta) tools to automate captioning

Plugins - (beta) write your own plugins to execute arbitrary code during training

Contributing