huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-07-26 01:40:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
929 Commits 239 Branches 64 Tags 34 MiB
feature/radix-prefix-cache-bench
Commit Graph

10 Commits

Author SHA1 Message Date
Erik Kaunismäki
07441f5a7a
legacy warning on text_generation client () 
Update README.md

point to huggingface_hub inference clients instead
 2024-07-22 12:00:17 +02:00
OlivierDehaene
08e9181418
feat: update client to 0.7 () 
Close
2024-03-22 17:10:56 +01:00
OlivierDehaene
9946165ee0
chore: add pre-commit () 2024-02-16 11:58:58 +01:00
OlivierDehaene
3b56d7669b
feat: add mistral model () 2023-09-28 09:55:47 +02:00
OlivierDehaene
895c5f1562
feat(server): only compute prefill logprobs when asked () 
Close
2023-06-02 17:12:30 +02:00
OlivierDehaene
b927244eb5
feat(python-client): get list of currently deployed tgi models using the inference API () 2023-04-17 18:43:24 +02:00
OlivierDehaene
d8dc8f1b0c
feat(python-client): add new parameters () 2023-03-09 16:05:33 +01:00
OlivierDehaene
2c5df5d2af
fix(python-client): stream not set on the sync client () 2023-03-08 16:48:16 +01:00
OlivierDehaene
0ac38d336a
feat(launcher): allow parsing num_shard from CUDA_VISIBLE_DEVICES () 2023-03-08 11:06:59 +01:00
OlivierDehaene
3fef90d50f
feat(clients): Python client () 2023-03-07 18:52:22 +01:00