huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 04:14:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Client modified to accept new string.

Browse Source 
The text-generation client can now accept the new string model_id returned by the RUST
router
This commit is contained in:
Suvro Ghosh 2023-11-01 11:15:07 -04:00
parent 897ed20842
commit e8ed11be3e
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
clients/python/text_generation/types.py
View File

@ -215,6 +215,8 @@ class Response(BaseModel):
generated_text: str generated_text: str
# Generation details # Generation details
details: Details details: Details
# model id
model_id: str
# `generate_stream` details # `generate_stream` details