huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-11 16:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
3eb4823f3e
text-generation-inference/backends/llamacpp/src
History
Adrien Gallouët 3eb4823f3e
Use max_batch_total_tokens 
Signed-off-by: Adrien Gallouët <angt@huggingface.co>
2025-02-04 13:32:58 +00:00
..
backend.rs Use max_batch_total_tokens 2025-02-04 13:32:58 +00:00
main.rs Use max_batch_total_tokens 2025-02-04 13:32:58 +00:00
wrapper.h Add llamacpp backend 2025-02-04 13:32:56 +00:00