huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-27 04:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,065 Commits 230 Branches 59 Tags 24 MiB
c396c54231
Commit Graph

3 Commits

Author SHA1 Message Date
David Holtz
c396c54231 fix: adjust test to only run on cuda 2024-10-09 20:02:29 +00:00
David Holtz
247033b45f fix: address ruff unsued vars lint 2024-10-09 18:58:35 +00:00
David Holtz
a8108bc0da feat: add basic test for the warmup step and memory allocation of the kv cache 2024-10-09 13:49:11 +00:00