some runpod tweaks

Train-Runpod.ipynb

@@ -29,8 +29,6 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "I_LIKE_FUN_STUFF = False  #change to True for fun mode, True with a capital T\n",
-    "\n",
     "!git clone https://github.com/victorchall/everydream-trainer\n",
     "%cd everydream-trainer\n",
     "\n",
@@ -152,6 +150,10 @@
     "\n",
     "Ues the navigation on the left to open **\"every-dream-trainer\"** folder, then open **\"input\"** and upload your training files using the **up arrow button** above the file explorer.  \n",
     "\n",
+    "You can upload your images while you wait for the base checkpoint to download above, but do not continue until the checkpoint download is done.\n",
+    "\n",
+    "If your captions are in .txt files, upload those in the same folder as the images. \n",
+    "\n",
     "![upload](./demo/runpodupload.png)\n",
     "\n",
     "You can check there are files in the folder by running the cell below (optional, just prints first 10)."
@@ -159,10 +161,19 @@
   },
   {
    "cell_type": "code",
-   "execution_count": null,
+   "execution_count": 1,
    "id": "af711a9c-7a50-49a1-a571-439d62a9587c",
    "metadata": {},
-   "outputs": [],
+   "outputs": [
+    {
+     "name": "stderr",
+     "output_type": "stream",
+     "text": [
+      "'ls' is not recognized as an internal or external command,\n",
+      "operable program or batch file.\n"
+     ]
+    }
+   ],
    "source": [
     "!ls -U input | head -10\n",
     "# at least a few image filenames should show below, if not you uploaded to the wrong folder"
@@ -182,7 +193,7 @@
     "\n",
     "[Runpod YAML](configs/stable-diffusion/v1-finetune_runpod.yaml) is a good starting point for small datasets (30-50 images) and **is the default in the command below**. It will only keep 2 checkpoints.\n",
     "\n",
-    "[EveryDream YAML](configs/stable-diffusion/v1-finetune_everydream.yaml) is a good starting point for *large* datasets (2000+). You will need to change the filename in the --config parameter below to use this.  This may create a LOT of large ckpt files while training, so make sure you have enough space in your runpod instance!  60GB+ is recommended."
+    "If you need help with larger training, join the Discord for advice on making a custom yaml."
    ]
   },
   {
@@ -199,6 +210,17 @@
     "print(f\"yaml set to: {my_yaml}\")"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "id": "c7d909e7",
+   "metadata": {},
+   "source": [
+    "## Run the trainer\n",
+    "Next cell runs training.  This will take a while depending on your number of images, repeats, and max_epochs.  \n",
+    "\n",
+    "You can watch for test images in the logs folder."
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,
@@ -240,7 +262,7 @@
     "\n",
     "Use the file explorer on the left, go into the \"every-dream-trainer\" folder.\n",
     "\n",
-    "Look for all the ckpt files that say \"-pruned\" on the end.  Download them and you're done! \n",
+    "Look for all the ckpt files that say \"-pruned\" on the end.  Download them and you're done!  Test each one in your favorite webui.\n",
     "\n",
     "[EveryDream Discord](https://discord.gg/uheqxU6sXN)"
    ]

configs/stable-diffusion/v1-finetune_runpod.yaml

@@ -96,7 +96,7 @@ lightning:
     image_logger:
       target: main.ImageLogger
       params:
-        batch_frequency: 150
+        batch_frequency: 250
         max_images: 16
         increase_log_steps: False