huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-10 23:45:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
33 Commits 240 Branches 66 Tags 36 MiB
a172430d8b
Commit Graph

3 Commits

Author SHA1 Message Date
Nick Hill
a172430d8b fix: Some small fixes 
- Avoid theoretical hang in batcher loop
- Avoid a couple of clones in py server generate method
- Keep attention mask tensors as integers
 2022-12-01 16:19:12 -08:00
OlivierDehaene
4236e41b0d feat(server): Improved doc 2022-11-07 12:53:56 +01:00
OlivierDehaene
427d7cc444 feat(server): Support AutoModelForSeq2SeqLM 2022-11-04 18:03:04 +01:00