huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-06-18 07:12:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,410 Commits 235 Branches 62 Tags 32 MiB

Default Branch

main

0627983c17 · [Gaudi] use pad_token_id to pad input id (#3268) · Updated 2025-06-17 07:07:25 +00:00
 ZIP  TAR.GZ

Branches

git_v3.0.1

bb9095aae3 · Updating lock. · Updated 2024-12-11 20:12:49 +00:00
220
2
 ZIP  TAR.GZ
trtllm/executor_stats

b653605e54 · feat(trtllm): fix logits retrieval · Updated 2024-12-10 22:28:13 +00:00
247
30
 ZIP  TAR.GZ
git_v3.0.0

8f326c9791 · Fixing lockfile. · Updated 2024-12-09 20:20:59 +00:00
236
2
 ZIP  TAR.GZ
pr-2784-ci-branch

600d7e6ece · Update server/text_generation_server/adapters/lora.py · Updated 2024-12-02 05:02:02 +00:00
254
2
 ZIP  TAR.GZ
git_v2.4.1

d2ed52f531 · v2.4.1 · Updated 2024-11-22 17:28:39 +00:00
259
1
 ZIP  TAR.GZ
ipex-moe

53b6f6e604 · Apply suggestions from code review · Updated 2024-11-18 11:28:07 +00:00
267
8
 ZIP  TAR.GZ
pr-2711-ci-branch

a604bfe450 · fix: run pre commit lints · Updated 2024-11-01 16:11:57 +00:00    Leaf

286
2
 ZIP  TAR.GZ
trtllm-stop-words

3bb78a8266 · misc(deps): update ompi from 4.1.6 to 4.1.7rc1 to avoid strange deadlock · Updated 2024-10-28 16:24:08 +00:00    Leaf

314
80
 ZIP  TAR.GZ
upgrade-outlines

7bc2c97bd9 · Check if allowed tokens is None (#2694) · Updated 2024-10-28 04:10:55 +00:00    Leaf

292
3
 ZIP  TAR.GZ
git_v2.4.0

0a655a0ab5 · v2.4.0 · Updated 2024-10-25 21:12:49 +00:00    Leaf

296
1
 ZIP  TAR.GZ
auto_length

e3db525917 · Fix integration mt0 (transformers update). · Updated 2024-10-24 09:54:11 +00:00    Leaf

313
12
 ZIP  TAR.GZ
close_dl_thread

fe8d55dba9 · Clean both threads. · Updated 2024-10-21 12:49:07 +00:00    Leaf

313
2
 ZIP  TAR.GZ
adjust-where-request-max-tokens-is-defaulted

b3917ff695 · fix: add limit to internal stream function too · Updated 2024-10-15 15:14:04 +00:00    Leaf

324
2
 ZIP  TAR.GZ
feature/machete

c9e0f36dbc · Machete WIP · Updated 2024-10-14 13:46:00 +00:00    Leaf

335
1
 ZIP  TAR.GZ
add-test-for-warmup-and-kvcache

99b1cf5948 · fix: rerun linter · Updated 2024-10-09 20:10:31 +00:00    Leaf

336
6
 ZIP  TAR.GZ
add-rotary-embed-tests

130f9d16b5 · fix: rerun black lint · Updated 2024-10-09 18:44:41 +00:00    Leaf

337
3
 ZIP  TAR.GZ
bugfix/moe-kernels-imports

e618ce3ada · Fix: make moe_kernels imports conditional · Updated 2024-10-08 11:05:28 +00:00    Leaf

339
1
 ZIP  TAR.GZ
add-google-cloud-provider

74489227e0 · Add Google Cloud in docs/source/references/api_reference.md · Updated 2024-10-05 14:54:17 +00:00    Leaf

343
2
 ZIP  TAR.GZ
add_tunable_prefill

11d7af730b · add cloning in Dockerfile · Updated 2024-10-04 17:41:02 +00:00    Leaf

353
6
 ZIP  TAR.GZ
enable-non-grammar-constrained-tools

3f07ddb469 · feat: support llama 3.1 tooling and remove grammar schema · Updated 2024-10-03 20:48:49 +00:00    Leaf

346
1
 ZIP  TAR.GZ