huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 12:24:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

fixes fatal error in generate()

Browse Source 
When using the non-streaming endpoint, the payload is not returned as a list of dictionaries, but as a single dictionary. Trying to index into it raises a `KeyError`.

The fix is to simply remove the index operation and unpack the payload directly.
This commit is contained in:
Simon Stone 2024-02-19 09:08:54 -05:00 committed by GitHub
parent 4139054b82
commit c74c7fc65b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
clients/python/text_generation/client.py
View File

@ -154,7 +154,7 @@ class Client:
payload = resp.json() payload = resp.json()
if resp.status_code != 200: if resp.status_code != 200:
raise parse_error(resp.status_code, payload) raise parse_error(resp.status_code, payload)
return Response(**payload[0]) return Response(**payload)
def generate_stream( def generate_stream(
self, self,