huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-25 12:02:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
600d7e6ece
text-generation-inference/backends/trtllm/src
History
OlivierDehaene ab7ccf5bc3
feat: add payload limit (#2726) 
* feat: add payload limit

* update launcher
2024-11-21 18:20:15 +00:00
..
errors.rs [TENSORRT-LLM] - Implement new looper thread based backend (#2357) 2024-10-25 07:17:14 +02:00
ffi.cpp Add support for stop words in TRTLLM (#2678) 2024-10-25 10:58:34 +02:00
lib.rs [TENSORRT-LLM] - Implement new looper thread based backend (#2357) 2024-10-25 07:17:14 +02:00
looper.rs Add support for stop words in TRTLLM (#2678) 2024-10-25 10:58:34 +02:00
main.rs feat: add payload limit (#2726) 2024-11-21 18:20:15 +00:00
utils.rs [TENSORRT-LLM] - Implement new looper thread based backend (#2357) 2024-10-25 07:17:14 +02:00