hf_text-generation-inference/server/README.md

15 lines
172 B
Markdown
Raw Permalink Normal View History

# Text Generation Inference Python gRPC Server
2022-10-08 04:30:12 -06:00
A Python gRPC server for Text Generation Inference
2022-10-08 04:30:12 -06:00
## Install
2022-10-08 04:30:12 -06:00
```shell
make install
```
## Run
2022-10-08 04:30:12 -06:00
```shell
make run-dev
2022-10-08 04:30:12 -06:00
```