hf_text-generation-inference/router/src
OlivierDehaene a2985036aa
feat(server): Add model tests (#6)
2022-12-08 18:49:33 +01:00
..
batcher.rs feat(server): Add model tests (#6) 2022-12-08 18:49:33 +01:00
db.rs feat(server): Support AutoModelForSeq2SeqLM 2022-11-04 18:03:04 +01:00
lib.rs feat(server): Support bitsandbytes 2022-10-27 14:25:29 +02:00
main.rs feat: Use json formatter by default in docker image 2022-11-02 17:29:56 +01:00
server.rs fix(batching): Avoid theoretical hang in batcher loop (#5) 2022-12-05 10:10:59 +01:00
validation.rs fix(batching): Avoid theoretical hang in batcher loop (#5) 2022-12-05 10:10:59 +01:00