huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-26 12:32:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,229 Commits 230 Branches 59 Tags 24 MiB
fe7594e369
Commit Graph

2 Commits

Author SHA1 Message Date
geoffrey papilion
e36a9c57f0
Code expects newer huggingface_hub versions, tested and this resolves issues with streaming response format (#190) 
Co-authored-by: Geoffrey Papilion <gpapilion@ebay.com>
 2024-08-08 13:07:27 +02:00
Karol Damaszke
9796b0e10d
Add simple continuous batching benchmark (#108) 
Co-authored-by: Karol Damaszke <kdamaszke@habana.ai>
Co-authored-by: regisss <15324346+regisss@users.noreply.github.com>
 2024-03-26 09:17:55 +01:00