From 521db377b48e7e52cfe73297408114ad8a430829 Mon Sep 17 00:00:00 2001 From: Cyberes Date: Sun, 15 Oct 2023 14:57:14 -0600 Subject: [PATCH] docker: update readme --- other/vllm/Docker/README.md | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-) diff --git a/other/vllm/Docker/README.md b/other/vllm/Docker/README.md index 5c51728..fb0d019 100644 --- a/other/vllm/Docker/README.md +++ b/other/vllm/Docker/README.md @@ -30,9 +30,7 @@ You **must** have a GPU attached to your system when building the container (required for building VLLM). 1. Install the [NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html) and CUDA 11.8. -2. `sudo docker build .` - If you want to build the latest VLLM, add `--no-cache` - Don't forget about `--progress=plain` +2. `sudo docker build .` If you want to build the latest VLLM, add `--no-cache` To run the container on your local machine: @@ -42,7 +40,7 @@ sudo docker run -it --shm-size 14g --gpus all -v /home/user/testing123/notebooks You will need to create a directory to mount inside the container (for example: `/home/user/testing123/`). Within this should be the folder `models` that holds the model to load, `rathole-client.toml`, and `cmd.txt`. -If you need to debug something you can start a shell inside the container: +If you need to debug something, you can start a shell inside the container: ```bash sudo docker run -it --shm-size 14g --gpus all -v /home/user/testing123/notebooks:/notebooks -v /home/user/testing123/storage:/storage -p 8888:8888 --entrypoint bash cyberes/vllm-paperspace:latest