huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-08 22:45:23 +00:00
Code Issues Packages Projects Releases Wiki Activity
69674a3a2d
text-generation-inference/backends/trtllm
History
Morgan Funtowicz 69674a3a2d add all the necessary plumbery to return the generated content
2024-07-17 22:12:49 +00:00
..
cmake impl RwLock scenario for TensorRtLllmBackend 2024-07-16 20:08:10 +00:00
include make sure the context is not dropped in the middle of the async decoding. 2024-07-17 21:56:50 +00:00
lib make sure the context is not dropped in the middle of the async decoding. 2024-07-17 21:56:50 +00:00
scripts Overall build TRTLLM and deps through CMake build system 2024-07-02 17:16:27 +02:00
src add all the necessary plumbery to return the generated content 2024-07-17 22:12:49 +00:00
tests First version loading engines and making it ready for inference 2024-07-03 21:12:24 +00:00
build.rs impl RwLock scenario for TensorRtLllmBackend 2024-07-16 20:08:10 +00:00
Cargo.toml make sure the context is not dropped in the middle of the async decoding. 2024-07-17 21:56:50 +00:00
CMakeLists.txt use external fmt lib 2024-07-12 19:24:59 +00:00