huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 15:32:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,066 Commits 228 Branches 59 Tags 47 MiB
99b1cf5948
Commit Graph

4 Commits

Author SHA1 Message Date
David Holtz
99b1cf5948 fix: rerun linter 2024-10-09 20:10:31 +00:00
David Holtz
c396c54231 fix: adjust test to only run on cuda 2024-10-09 20:02:29 +00:00
David Holtz
247033b45f fix: address ruff unsued vars lint 2024-10-09 18:58:35 +00:00
David Holtz
a8108bc0da feat: add basic test for the warmup step and memory allocation of the kv cache 2024-10-09 13:49:11 +00:00