Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
638 Commits 60 Branches 39 Tags 9.1 MiB

Default Branch

main

88702d8763 · Fixing CI. (#1748) · Updated 2024-04-15 10:47:36 -06:00
 ZIP  TAR.GZ

Branches

add_batch_dimension

81fa53f37b · Fix tests. · Updated 2024-02-08 08:25:34 -07:00
84
4
 ZIP  TAR.GZ
update_peft

e10530d4f3 · update to peft 0.8.2 · Updated 2024-02-06 12:41:15 -07:00
84
1
 ZIP  TAR.GZ
upgrade_axum

4c6c39e491 · Upgrading axum=0.7 · Updated 2024-02-02 04:15:32 -07:00
86
1
 ZIP  TAR.GZ
add_readme_dashboard

c10c4a023a · Github magic? · Updated 2024-02-01 09:13:37 -07:00
86
7
 ZIP  TAR.GZ
revert

1e03b61b5c · Revert "Modify default for max_new_tokens in python client (#1336)" · Updated 2024-02-01 07:36:10 -07:00
88
0
 Included
 ZIP  TAR.GZ
debug-request-id

b71557d956 · add request id in logs · Updated 2024-02-01 05:47:04 -07:00
90
1
 ZIP  TAR.GZ
update_readme

94d243b3d7 · Freshen up the README. · Updated 2024-02-01 02:23:37 -07:00
90
0
 Included
 ZIP  TAR.GZ
mamba2

a3c45da0a4 · Improvments within mamba. · Updated 2024-01-31 03:28:58 -07:00
115
7
 ZIP  TAR.GZ
fix_neox_rotary_emb

871e5e7338 · fix rotary dim · Updated 2024-01-29 20:53:08 -07:00
97
2
 ZIP  TAR.GZ
bump-poetry-and-requirements

fc86dba781 · fix: ensure latest requirements exported · Updated 2024-01-26 09:26:34 -07:00
100
2
 ZIP  TAR.GZ
update_docs2

45978034c9 · Pre-emptive on sealion. · Updated 2024-01-26 02:15:31 -07:00
108
1
 ZIP  TAR.GZ
support-phi-model

31b23f98ff · feat: boilerplate phi2 model integration · Updated 2024-01-10 07:42:26 -07:00
122
1
 ZIP  TAR.GZ
fix/avoid_record_streams

65db02f192 · fix: use TORCH_NCCL_AVOID_RECORD_STREAMS=1 · Updated 2024-01-09 09:59:16 -07:00
122
1
 ZIP  TAR.GZ
medusa

5b340a5ffd · Dump work. · Updated 2023-11-30 15:05:51 -07:00
155
8
 ZIP  TAR.GZ
feat/cuda_12

8a7771a33c · Use cuda devel instead · Updated 2023-10-11 02:40:06 -06:00
182
2
 ZIP  TAR.GZ
feat/attention_sinks

56de96abe9 · missing arg · Updated 2023-10-05 07:14:17 -06:00
185
3
 ZIP  TAR.GZ
dev

c35f39cf83 · Add AWQ quantization inference support (#1019) · Updated 2023-09-25 01:58:02 -06:00
217
1
 ZIP  TAR.GZ
speculative

33958e0989 · Start. · Updated 2023-09-11 12:25:49 -06:00
222
1
 ZIP  TAR.GZ
self-generating-docs

4bac76241d · Update server.rs · Updated 2023-08-21 02:10:57 -06:00
246
5
 ZIP  TAR.GZ
improve-docs

cf43528538 · remove stream since its a separate PR · Updated 2023-08-18 04:57:36 -06:00
248
6
 ZIP  TAR.GZ