hf_text-generation-inference/server/text_generation_server/utils
OlivierDehaene 68e9d6ab33
feat(server): shard token decode (#303)
2023-05-10 15:48:21 +02:00
..
__init__.py feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00
convert.py fea(server): decrease convert RAM requirements (#286) 2023-05-05 17:57:02 +02:00
dist.py feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00
hub.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
tokens.py feat(server): shard token decode (#303) 2023-05-10 15:48:21 +02:00
watermark.py fix(server): fix flash-neox scores warping (#137) 2023-03-24 18:21:41 +01:00