hf_text-generation-inference/server/text_generation_server/models
OlivierDehaene ad66f6ef9a
feat(server): optim flash causal lm decode_token (#285)
2023-05-09 18:26:19 +02:00
..
custom_modeling feat(server): optim flash causal lm decode_token (#285) 2023-05-09 18:26:19 +02:00
__init__.py feat(server): add watermarking tests (#248) 2023-04-27 19:16:35 +02:00
bloom.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
causal_lm.py fix(server): fix typo in tokenizers decode (#269) 2023-05-03 10:10:34 +02:00
flash_causal_lm.py feat(server): optim flash causal lm decode_token (#285) 2023-05-09 18:26:19 +02:00
flash_llama.py feat(server): optim flash causal lm decode_token (#285) 2023-05-09 18:26:19 +02:00
flash_neox.py feat(server): optim flash causal lm decode_token (#285) 2023-05-09 18:26:19 +02:00
flash_santacoder.py feat(server): optim flash causal lm decode_token (#285) 2023-05-09 18:26:19 +02:00
galactica.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
gpt_neox.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
model.py feat(router): add device and dtype info (#215) 2023-04-21 15:36:29 +02:00
opt.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
santacoder.py fix(server): fix typo in tokenizers decode (#269) 2023-05-03 10:10:34 +02:00
seq2seq_lm.py fix(server): Small tidy of code from recent changes (#251) 2023-04-27 09:57:28 +02:00
t5.py feat(server): support hf endpoint weight layout (#266) 2023-05-03 11:36:24 +02:00
types.py feat(router): drop requests when client closes the channel (#202) 2023-04-20 11:07:40 +02:00