huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
c5846ee73a
text-generation-inference/server/tests/models
History
OlivierDehaene ebc74d5666
feat(router): use number of tokens in batch as input for dynamic batching (#226) 
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
2023-04-24 17:59:00 +02:00
..
test_bloom.py feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
test_causal_lm.py feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
test_santacoder.py feat(router): make router input validation optional (#164) 2023-04-09 20:22:27 +02:00
test_seq2seq_lm.py feat(server): reduce memory requirement (#214) 2023-04-24 14:15:42 +02:00