huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 16:02:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
c922ef9534
text-generation-inference/backends/trtllm/src
History
Funtowicz Morgan c3401e0b99 More fixes trtllm (#2342) 
* (backend) use parking_lot crate for RwLock fairness

* (docker) let's put rust in the TRTLLM folder when building

* (docker) build ompi with SLURM support

* (launcher) default new server::run parameters to false for now

* (chore) fmt ... why?
2024-09-25 06:08:00 +00:00
..
backend.rs More fixes trtllm (#2342) 2024-09-25 06:08:00 +00:00
errors.rs Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00
ffi.cpp Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00
lib.rs Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00
main.rs More fixes trtllm (#2342) 2024-09-25 06:08:00 +00:00