huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-19 13:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,368 Commits 227 Branches 59 Tags 46 MiB

Default Branch

main

8f8819795f · Fixing CI (#3184) · Updated 2025-04-18 11:07:18 +00:00
 ZIP  TAR.GZ

Branches

medusa

5b340a5ffd · Dump work. · Updated 2023-11-30 22:05:51 +00:00    Leaf

863
8
 ZIP  TAR.GZ
feat/cuda_12

8a7771a33c · Use cuda devel instead · Updated 2023-10-11 08:40:06 +00:00    Leaf

890
2
 ZIP  TAR.GZ
feat/attention_sinks

56de96abe9 · missing arg · Updated 2023-10-05 13:14:17 +00:00    Leaf

893
3
 ZIP  TAR.GZ
dev

c35f39cf83 · Add AWQ quantization inference support (#1019) · Updated 2023-09-25 07:58:02 +00:00    Leaf

925
1
 ZIP  TAR.GZ
speculative

33958e0989 · Start. · Updated 2023-09-11 18:25:49 +00:00    Leaf

930
1
 ZIP  TAR.GZ
self-generating-docs

4bac76241d · Update server.rs · Updated 2023-08-21 08:10:57 +00:00    Leaf

954
5
 ZIP  TAR.GZ
improve-docs

cf43528538 · remove stream since its a separate PR · Updated 2023-08-18 10:57:36 +00:00    Leaf

956
6
 ZIP  TAR.GZ
fix_leak

89a4e723d2 · Attempting to fix torch leak. · Updated 2023-08-12 07:06:49 +00:00    Leaf

991
1
 ZIP  TAR.GZ
streaming_conceptual

4a9615e8ff · Add to ToC · Updated 2023-08-11 13:05:10 +00:00    Leaf

994
2
 ZIP  TAR.GZ
test_docs

43ed6c217a · Dummy commit · Updated 2023-08-10 08:33:52 +00:00    Leaf

977
1
 ZIP  TAR.GZ
osanseviero-patch-1

4ddb6681ac · Add workflow to upload documentation · Updated 2023-08-08 05:49:45 +00:00    Leaf

980
1
 ZIP  TAR.GZ
model_compat_log

e994ad1172 · Added InferenceClient · Updated 2023-08-02 14:57:01 +00:00    Leaf

994
11
 ZIP  TAR.GZ
compat_logger

7766fee9b1 · fix typo for dynamic rotary (#745) · Updated 2023-07-31 16:58:46 +00:00    Leaf

988
0
 Included
 ZIP  TAR.GZ
simpler_exllama

f555dabca8 · Putting back header inclusion (seems unused but still) · Updated 2023-07-20 15:46:51 +00:00    Leaf

1015
21
 ZIP  TAR.GZ
bnb4

bfa3920aec · BNB 4bits. · Updated 2023-07-12 12:42:43 +00:00    Leaf

1041
7
 ZIP  TAR.GZ
enable_non_divisible_embeddings

db4efbf4bc · fix(server): T5 weights names. (#582) · Updated 2023-07-12 08:01:42 +00:00    Leaf

1037
0
 Included
 ZIP  TAR.GZ
feat/better_tokens

a4fd6905d8 · fmt · Updated 2023-06-23 13:01:05 +00:00    Leaf

1064
2
 ZIP  TAR.GZ
add_integration_test

dca0fe2585 · Adding GPTQ integration tests. · Updated 2023-06-19 12:14:17 +00:00    Leaf

1067
19
 ZIP  TAR.GZ
add_gptq_docs

17837b1e51 · Adding docs about GPTQ usage. · Updated 2023-06-15 17:41:04 +00:00    Leaf

1067
19
 ZIP  TAR.GZ
quantization

fb0840944c · Reducing number of reps while autotuning. · Updated 2023-06-06 11:56:10 +00:00    Leaf

1118
9
 ZIP  TAR.GZ