Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/server
History
Olivier Dehaene 4c693e6524 Refactored gRPC interface 
Added validation logic
 		2022-10-11 16:50:54 +02:00
..
bloom_inference Refactored gRPC interface 2022-10-11 16:50:54 +02:00
Makefile Init 2022-10-08 12:30:12 +02:00
README.md Init 2022-10-08 12:30:12 +02:00
poetry.lock Init 2022-10-08 12:30:12 +02:00
pyproject.toml Init 2022-10-08 12:30:12 +02:00

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Local Install (with poetry)

make install

Local Install (with pip)

make pip-install