Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/server
History
Olivier Dehaene f11965c11d support deepspeed 2022-10-13 11:05:44 +02:00
..
bloom_inference support deepspeed 2022-10-13 11:05:44 +02:00
Makefile Init 2022-10-08 12:30:12 +02:00
README.md Init 2022-10-08 12:30:12 +02:00
poetry.lock support deepspeed 2022-10-13 11:05:44 +02:00
pyproject.toml support deepspeed 2022-10-13 11:05:44 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Local Install (with poetry)

make install

Local Install (with pip)

make pip-install