hf_text-generation-inference/server/README.md

# Text Generation Inference Python gRPC Server

A Python gRPC server for Text Generation Inference

## Install

```shell
make install
```

## Run

```shell
make run-dev
```
feat(router): refactor API and add openAPI schemas (#53) 2023-02-03 04:43:37 -07:00			`# Text Generation Inference Python gRPC Server`
Init 2022-10-08 04:30:12 -06:00
feat(router): refactor API and add openAPI schemas (#53) 2023-02-03 04:43:37 -07:00			`A Python gRPC server for Text Generation Inference`
Init 2022-10-08 04:30:12 -06:00
feat(server): Use safetensors Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com> 2022-10-22 12:00:15 -06:00			`## Install`
Init 2022-10-08 04:30:12 -06:00
			```shell
			`make install`
			```

feat(server): Use safetensors Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com> 2022-10-22 12:00:15 -06:00			`## Run`
Init 2022-10-08 04:30:12 -06:00
			```shell
feat(server): Use safetensors Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com> 2022-10-22 12:00:15 -06:00			`make run-dev`
Init 2022-10-08 04:30:12 -06:00			```