hf_text-generation-inference/server/README.md

15 lines
152 B
Markdown

# BLOOM Inference Python gRPC Server
A Python gRPC server for BLOOM Inference
## Install
```shell
make install
```
## Run
```shell
make run-dev
```