hf_text-generation-inference/router
OlivierDehaene 1539d3cbbe
feat(router): Remove second lock from batcher hot path (#27)
@njhill
2023-01-26 16:29:13 +01:00
..
client feat: Return logprobs (#8) 2022-12-15 17:03:56 +01:00
src feat(router): Remove second lock from batcher hot path (#27) 2023-01-26 16:29:13 +01:00
Cargo.toml feat(router): Remove second lock from batcher hot path (#27) 2023-01-26 16:29:13 +01:00