Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,192 Commits 189 Branches 52 Tags 605 MiB

Default Branch

main

23bc38b10d · fix: include add_special_tokens in kserve request (#2859) · Updated 2024-12-19 14:55:17 -07:00
 ZIP  TAR.GZ

Branches

trtllm/ci

462dcfea85 · misc(backend): attempt to run the tests? · Updated 2024-12-21 04:17:32 -07:00
29
89
 ZIP  TAR.GZ
improve-vlm-support

575d97339c · fix: create new idefic3 file, simplify logic and adjust llama weight loading · Updated 2024-12-20 17:27:29 -07:00
3
11
 ZIP  TAR.GZ
fix-docker-run-readme

08b39d1ae2 · Fix `docker run` in `README.md` · Updated 2024-12-20 03:20:51 -07:00
0
1
 ZIP  TAR.GZ
fp8_kvcache_rocm

fa14d71ac8 · add fp8 kv cache for rocm · Updated 2024-12-18 07:55:53 -07:00
2
1
 ZIP  TAR.GZ
flash_decoding_rocm

8936a0379d · Merge branch 'main' into flash_decoding_rocm · Updated 2024-12-18 05:44:51 -07:00
2
7
 ZIP  TAR.GZ
rocm-fp8-tensorwise

f8771d0a83 · nm changes · Updated 2024-12-18 05:15:28 -07:00
2
8
 ZIP  TAR.GZ
enable-qwen2vl-video

93a2413ba6 · fix: adjust trtllm looper for video chunk enum · Updated 2024-12-17 18:41:27 -07:00
3
51
 ZIP  TAR.GZ
pr-2840-ci-branch

f89bdb72c8 · Fix runtime error when Qwen2-VL was prompted with multiple images · Updated 2024-12-16 14:15:43 -07:00
4
2
 ZIP  TAR.GZ
trtllm/finish_reason

0ac61165fe · misc(llamacpp): fix typo · Updated 2024-12-13 09:13:29 -07:00
7
2
 ZIP  TAR.GZ
fix_fp8_llama3.2

1fa9ca2f16 · add fix · Updated 2024-12-13 09:10:00 -07:00
8
1
 ZIP  TAR.GZ
feat-backend-llamacpp

182ffaf064 · misc: use return Ok(()) · Updated 2024-12-12 08:04:05 -07:00
72
92
 ZIP  TAR.GZ
s3-cache

1ca37d3353 · misc(ci): let's use the correct way to invoke sccache · Updated 2024-12-11 14:18:54 -07:00
15
15
 ZIP  TAR.GZ
git_v3.0.1

bb9095aae3 · Updating lock. · Updated 2024-12-11 13:12:49 -07:00
13
2
 ZIP  TAR.GZ
trtllm/executor_stats

b653605e54 · feat(trtllm): fix logits retrieval · Updated 2024-12-10 15:28:13 -07:00
29
30
 ZIP  TAR.GZ
improve-qwen2-vl-warmup

a3049f102e · fix: address image resize and rebase changes · Updated 2024-12-09 14:26:14 -07:00
17
3
 ZIP  TAR.GZ
git_v3.0.0

8f326c9791 · Fixing lockfile. · Updated 2024-12-09 13:20:59 -07:00
18
2
 ZIP  TAR.GZ
pr-2784-ci-branch

600d7e6ece · Update server/text_generation_server/adapters/lora.py · Updated 2024-12-01 22:02:02 -07:00
36
2
 ZIP  TAR.GZ
install-from-poetry-lock

63b8c59d9f · Add `poetry-plugin-export` and fix indentation · Updated 2024-11-29 06:16:01 -07:00
35
5
 ZIP  TAR.GZ
git_v2.4.1

d2ed52f531 · v2.4.1 · Updated 2024-11-22 10:28:39 -07:00
41
1
 ZIP  TAR.GZ
ipex-moe

53b6f6e604 · Apply suggestions from code review · Updated 2024-11-18 04:28:07 -07:00
63
8
 ZIP  TAR.GZ