Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
176 Commits 181 Branches 49 Tags 605 MiB
Commit Graph

2 Commits

Author SHA1 Message Date
OlivierDehaene e14ae3b5e9
feat(server): support quantization for flash models (#200) 
closes #197
 2023-04-19 12:51:11 +02:00
OlivierDehaene 299217c95c
feat(server): add flash attention llama (#144) 2023-04-11 16:38:22 +02:00