diff --git a/README.md b/README.md index 8c735e8..9563f80 100644 --- a/README.md +++ b/README.md @@ -4,6 +4,7 @@ - [Setup](#setup) - [Easy RunPod Instructions](#easy-runpod-instructions) - [Vast.AI Setup](#vast-ai-setup) +- [Textual Inversion vs. Dreambooth](#text-vs-dreamb) - [Using the Generated Model](#using-the-generated-model) - [Debugging Your Results](#debugging-your-results) - [They don't look like you at all!](#they-dont-look-like-you) @@ -12,7 +13,7 @@ - [Hugging Face Diffusers](#hugging-face-diffusers) # The Repo Formerly Known As "Dreambooth" -## ...but is more correctly described as "Unfrozen Model Textual Inversion for Stable Diffusion" +## ...now more accurately described as "Unfrozen Model Textual Inversion for Stable Diffusion" ![image](https://user-images.githubusercontent.com/100188076/192390551-cb89364f-af57-4aed-8f3d-f9eb9b61cf95.png) ## Notes by Joe Penna @@ -85,6 +86,24 @@ Now, if you wanna try to do this... please read the warnings below first: - ![img.png](readme-images/vast-ai-step6-open-notebook.png) - Follow the instructions in the workbook and start training +# Textual Inversion vs. Dreambooth +The majority of the code in this repo was written by Rinon Gal et. al, the authors of the Textual Inversion research paper. + +A few bits about regularization images were added that we all thought were super important -- all the researchers included! + +...until my images were trained under the class "dog": +
+ +...and under the nonsensical class "§¶•" instead of "man" or "woman" or "person": +
+ +...and with completely blank regularization images: +
+ +So, because regularization has no effect, this isn't Dreambooth at all. + +This repo is more accurately called *"Unfrozen Model Textual Inversion for Stable Diffusion"*. + # Using the generated model The `ground truth` (real picture, caution: very beautiful woman)