huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
208 Commits 228 Branches 59 Tags 47 MiB
4096000e34
Commit Graph

3 Commits

Author SHA1 Message Date
OlivierDehaene
343437c7b5
feat(router): add device and dtype info (#215) 2023-04-21 15:36:29 +02:00
OlivierDehaene
880a76eed5
feat(server): support sharded santacoder (#167) 2023-04-12 17:18:08 +02:00
OlivierDehaene
f26dfd0dc1
feat(server): support OPT models (#55) 
OPT models do not all have a `tokenizer.json` file on the hub at the
moment. Can't merge for now.
 2023-04-11 19:16:41 +02:00