diff --git a/doc/VALIDATION.md b/doc/VALIDATION.md index 4cbede2..76f02cb 100644 --- a/doc/VALIDATION.md +++ b/doc/VALIDATION.md @@ -25,7 +25,7 @@ The training proceeds rapidly over the first 50 steps, with the model quickly ge | step 5 | step 17 | step 29 | step 41 | step 53 | |-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------| -| ![](validation/tb_04_20230128-222200/samples/gs00005-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00017-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00029-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00041-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00053-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | +| ![](validation/ted_bennett/gs00005-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00017-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00029-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00041-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00053-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | (In all of these images the prompt is `ted bennett in a grey suit and tie with his arms spread out`.) @@ -33,13 +33,13 @@ The training proceeds rapidly over the first 50 steps, with the model quickly ge | step 65 | step 77 | step 89 | step 101 | step 113 | |-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------| -| ![](validation/tb_04_20230128-222200/samples/gs00065-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00077-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00089-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00101-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00113-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | +| ![](validation/ted_bennett/gs00065-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00077-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00089-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00101-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00113-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | **In the third phase**, the model is starting to overfit: edges start to get a bit weird, the saturation becomes stronger; everything feels a whole lot more *intense* somehow: | step 125 | step 137 | step 149 | step 161 | step 173 | |-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------| -| ![](validation/tb_04_20230128-222200/samples/gs00125-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00137-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00149-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00161-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/tb_04_20230128-222200/samples/gs00173-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | +| ![](validation/ted_bennett/gs00125-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00137-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00149-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00161-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | ![](validation/ted_bennett/gs00173-1-ted bennett in a grey suit and tie with his arms spread out.jpg) | When the model starts looking like this that means you've gone past the best point and it's time to stop. Normally you would detect this point by watching the outputs, but you can also watch the `loss/val` graph and try and stop the training before it starts to become unstable or trend upward. diff --git a/doc/validation/basic-losses.png b/doc/validation/basic-losses.png new file mode 100644 index 0000000..4951732 Binary files /dev/null and b/doc/validation/basic-losses.png differ diff --git a/doc/validation/ted_bennett/gs00005-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00005-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..8ea704e Binary files /dev/null and b/doc/validation/ted_bennett/gs00005-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00017-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00017-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..39fc9eb Binary files /dev/null and b/doc/validation/ted_bennett/gs00017-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00029-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00029-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..791f51e Binary files /dev/null and b/doc/validation/ted_bennett/gs00029-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00041-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00041-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..2a49705 Binary files /dev/null and b/doc/validation/ted_bennett/gs00041-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00053-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00053-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..77a8c70 Binary files /dev/null and b/doc/validation/ted_bennett/gs00053-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00065-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00065-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..a8b7904 Binary files /dev/null and b/doc/validation/ted_bennett/gs00065-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00077-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00077-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..88e47ca Binary files /dev/null and b/doc/validation/ted_bennett/gs00077-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00089-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00089-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..2ad5025 Binary files /dev/null and b/doc/validation/ted_bennett/gs00089-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00101-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00101-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..e433fc0 Binary files /dev/null and b/doc/validation/ted_bennett/gs00101-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00113-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00113-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..9c436d3 Binary files /dev/null and b/doc/validation/ted_bennett/gs00113-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00125-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00125-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..40eaee1 Binary files /dev/null and b/doc/validation/ted_bennett/gs00125-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00137-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00137-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..b0f5d14 Binary files /dev/null and b/doc/validation/ted_bennett/gs00137-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00149-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00149-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..1bae12e Binary files /dev/null and b/doc/validation/ted_bennett/gs00149-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00161-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00161-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..a682130 Binary files /dev/null and b/doc/validation/ted_bennett/gs00161-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/ted_bennett/gs00173-1-ted bennett in a grey suit and tie with his arms spread out.jpg b/doc/validation/ted_bennett/gs00173-1-ted bennett in a grey suit and tie with his arms spread out.jpg new file mode 100644 index 0000000..e41a6c6 Binary files /dev/null and b/doc/validation/ted_bennett/gs00173-1-ted bennett in a grey suit and tie with his arms spread out.jpg differ diff --git a/doc/validation/train-stabilized.png b/doc/validation/train-stabilized.png new file mode 100644 index 0000000..c8a0f56 Binary files /dev/null and b/doc/validation/train-stabilized.png differ diff --git a/doc/validation/validation-losses.png b/doc/validation/validation-losses.png new file mode 100644 index 0000000..a452f63 Binary files /dev/null and b/doc/validation/validation-losses.png differ