hf_text-generation-inference/launcher
OlivierDehaene 5fd2dcb513
feat(launcher): default num_shard to CUDA_VISIBLE_DEVICES if possible (#108)
2023-03-08 13:53:41 +01:00
..
src feat(launcher): default num_shard to CUDA_VISIBLE_DEVICES if possible (#108) 2023-03-08 13:53:41 +01:00
tests fix(server): fix generate_stream by forcing tokens to be decoded correctly (#100) 2023-03-06 13:22:58 +01:00
Cargo.toml v0.3.2 (#97) 2023-03-03 18:42:20 +01:00