From 0c9611f25142808a0ec507714abd1f5a8af2f257 Mon Sep 17 00:00:00 2001 From: Xavier Date: Tue, 6 Sep 2022 09:35:58 -0700 Subject: [PATCH 1/2] Update README.md --- README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/README.md b/README.md index 7133ca3..13c1b3c 100644 --- a/README.md +++ b/README.md @@ -33,4 +33,7 @@ python main.py --base configs/stable-diffusion/v1-finetune_unfrozen.yaml --class_word ``` +Detailed configuration can be found in configs/stable-diffusion/v1-finetune_unfrozen.yaml. In particular, the default learning rate is ```1.0e-6``` as I found the ```1.0e-5``` in the Dreambooth paper leads to poor editability. The parameter ```reg_weight``` corresponds to the weight of regularization in the Dreambooth paper, and the default is set to ```1.0```. + + ### Generation From 1318e0795a2319d351711f318cce952df96e6de1 Mon Sep 17 00:00:00 2001 From: Xavier Date: Tue, 6 Sep 2022 09:40:06 -0700 Subject: [PATCH 2/2] Update README.md --- README.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 13c1b3c..2e0ac8d 100644 --- a/README.md +++ b/README.md @@ -33,7 +33,8 @@ python main.py --base configs/stable-diffusion/v1-finetune_unfrozen.yaml --class_word ``` -Detailed configuration can be found in configs/stable-diffusion/v1-finetune_unfrozen.yaml. In particular, the default learning rate is ```1.0e-6``` as I found the ```1.0e-5``` in the Dreambooth paper leads to poor editability. The parameter ```reg_weight``` corresponds to the weight of regularization in the Dreambooth paper, and the default is set to ```1.0```. +Detailed configuration can be found in ```configs/stable-diffusion/v1-finetune_unfrozen.yaml```. In particular, the default learning rate is ```1.0e-6``` as I found the ```1.0e-5``` in the Dreambooth paper leads to poor editability. The parameter ```reg_weight``` corresponds to the weight of regularization in the Dreambooth paper, and the default is set to ```1.0```. +Dreambooth requires a placeholder word ```[V]```, called identifier, as in the paper. This identifier needs to be a relatively rare tokens in the vocabulary. The original paper approaches this by using a rare word in T5-XXL tokenizer. For simplicity, here I just use a random word ```sks``` and hard coded it.. If you want to change that, simply make a change in [this file](https://github.com/XavierXiao/Dreambooth-Stable-Diffusion/blob/main/ldm/data/personalized.py#L10). ### Generation