This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
Mirrors
/
hf_text-generation-inference
mirror of
https://github.com/huggingface/text-generation-inference.git
Watch
1
Star
0
Fork
You've already forked hf_text-generation-inference
0
Code
Issues
Packages
Projects
Releases
Wiki
Activity
9025a26cea
hf_text-generation-inference
/
backends
/
llamacpp
History
Morgan Funtowicz
862a519fdd
misc(doc): rust documentation
2024-11-22 15:35:55 +01:00
..
cmake
feat(backend): bind thread and memory affinity for thread
2024-11-21 13:52:38 +01:00
csrc
misc(doc): c++ documentation
2024-11-22 15:13:54 +01:00
offline
feat(backend): simplify overall cpp structure
2024-11-14 08:42:01 +01:00
src
misc(doc): rust documentation
2024-11-22 15:35:55 +01:00
CMakeLists.txt
feat(backend): multistream inference on CPU
2024-11-21 00:03:05 +01:00
Cargo.toml
feat(backend): rely on multi consumer queue to scheduler workers
2024-11-22 13:32:56 +01:00
build.rs
feat(backend): bind thread and memory affinity for thread
2024-11-21 13:52:38 +01:00