This website requires JavaScript.
Explore
Help
Sign In
huggingface
/
text-generation-inference
Watch
5
Star
0
Fork
0
You've already forked text-generation-inference
mirror of
https://github.com/huggingface/text-generation-inference.git
synced
2025-04-27 04:52:07 +00:00
Code
Issues
Packages
Projects
Releases
Wiki
Activity
31747163e7
text-generation-inference
/
backends
/
trtllm
/
src
History
Morgan Funtowicz
fb00f985ae
chore(trtllm): post-rebase commit
2024-10-21 12:31:24 +02:00
..
errors.rs
feat(looper): check engine and executorWorker paths exist before creating the backend
2024-10-21 10:00:27 +02:00
ffi.cpp
(misc): disable logging in release mode
2024-10-21 10:00:27 +02:00
lib.rs
chore(trtllm): fmt
2024-10-21 10:00:27 +02:00
looper.rs
feat(looper): minor optimizations to avoid growing too much the containers
2024-10-21 10:00:27 +02:00
main.rs
chore(trtllm): post-rebase commit
2024-10-21 12:31:24 +02:00
utils.rs
(ffi) encode the provided user prompt within each request thread
2024-10-21 10:00:27 +02:00