Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,151 Commits 179 Branches 50 Tags 606 MiB

Default Branch

main

780531ec77 · chore: prepare 2.4.1 release (#2773) · Updated 2024-11-22 10:26:15 -07:00
 ZIP  TAR.GZ

Branches

add_batch_dimension

81fa53f37b · Fix tests. · Updated 2024-02-08 08:25:34 -07:00
597
4
 ZIP  TAR.GZ
update_peft

e10530d4f3 · update to peft 0.8.2 · Updated 2024-02-06 12:41:15 -07:00
597
1
 ZIP  TAR.GZ
add_readme_dashboard

c10c4a023a · Github magic? · Updated 2024-02-01 09:13:37 -07:00
599
7
 ZIP  TAR.GZ
revert

1e03b61b5c · Revert "Modify default for max_new_tokens in python client (#1336)" · Updated 2024-02-01 07:36:10 -07:00
601
0
 Included
 ZIP  TAR.GZ
debug-request-id

b71557d956 · add request id in logs · Updated 2024-02-01 05:47:04 -07:00
603
1
 ZIP  TAR.GZ
update_readme

94d243b3d7 · Freshen up the README. · Updated 2024-02-01 02:23:37 -07:00
603
0
 Included
 ZIP  TAR.GZ
mamba2

a3c45da0a4 · Improvments within mamba. · Updated 2024-01-31 03:28:58 -07:00
628
7
 ZIP  TAR.GZ
fix_neox_rotary_emb

871e5e7338 · fix rotary dim · Updated 2024-01-29 20:53:08 -07:00
610
2
 ZIP  TAR.GZ
bump-poetry-and-requirements

fc86dba781 · fix: ensure latest requirements exported · Updated 2024-01-26 09:26:34 -07:00
613
2
 ZIP  TAR.GZ
update_docs2

45978034c9 · Pre-emptive on sealion. · Updated 2024-01-26 02:15:31 -07:00
621
1
 ZIP  TAR.GZ
support-phi-model

31b23f98ff · feat: boilerplate phi2 model integration · Updated 2024-01-10 07:42:26 -07:00
635
1
 ZIP  TAR.GZ
fix/avoid_record_streams

65db02f192 · fix: use TORCH_NCCL_AVOID_RECORD_STREAMS=1 · Updated 2024-01-09 09:59:16 -07:00
635
1
 ZIP  TAR.GZ
medusa

5b340a5ffd · Dump work. · Updated 2023-11-30 15:05:51 -07:00
668
8
 ZIP  TAR.GZ
feat/cuda_12

8a7771a33c · Use cuda devel instead · Updated 2023-10-11 02:40:06 -06:00
695
2
 ZIP  TAR.GZ
feat/attention_sinks

56de96abe9 · missing arg · Updated 2023-10-05 07:14:17 -06:00
698
3
 ZIP  TAR.GZ
dev

c35f39cf83 · Add AWQ quantization inference support (#1019) · Updated 2023-09-25 01:58:02 -06:00
730
1
 ZIP  TAR.GZ
speculative

33958e0989 · Start. · Updated 2023-09-11 12:25:49 -06:00
735
1
 ZIP  TAR.GZ
self-generating-docs

4bac76241d · Update server.rs · Updated 2023-08-21 02:10:57 -06:00
759
5
 ZIP  TAR.GZ
improve-docs

cf43528538 · remove stream since its a separate PR · Updated 2023-08-18 04:57:36 -06:00
761
6
 ZIP  TAR.GZ
fix_leak

89a4e723d2 · Attempting to fix torch leak. · Updated 2023-08-12 01:06:49 -06:00
774
1
 ZIP  TAR.GZ