fxmarty 650fea1834 GPTQ support on ROCm (#1489) ... Tested with ``` CUDA_VISIBLE_DEVICES=0 text-generation-launcher --model-id TheBloke/Llama-2-7B-Chat-GPTQ --quantize gptq EXLLAMA_VERSION=1 CUDA_VISIBLE_DEVICES=0 text-generation-launcher --model-id TheBloke/Llama-2-7B-Chat-GPTQ --quantize gptq CUDA_VISIBLE_DEVICES="0,1" text-generation-launcher --model-id TheBloke/Llama-2-7B-Chat-GPTQ --quantize gptq ``` all with good and identical results on MI210. --------- Co-authored-by: Felix Marty <felix@hf.co> Co-authored-by: OlivierDehaene <olivier@huggingface.co> Co-authored-by: OlivierDehaene <23298448+OlivierDehaene@users.noreply.github.com>		2024-01-26 16:27:44 +01:00
..
source	GPTQ support on ROCm (#1489)	2024-01-26 16:27:44 +01:00
index.html	feat(router): refactor API and add openAPI schemas (#53)	2023-02-03 12:43:37 +01:00
openapi.json	Update the docs to include newer models. (#1492)	2024-01-26 16:07:31 +01:00