text-generation-inference/backends/trtllm/src
2024-10-21 12:31:24 +02:00
..
errors.rs feat(looper): check engine and executorWorker paths exist before creating the backend 2024-10-21 10:00:27 +02:00
ffi.cpp (misc): disable logging in release mode 2024-10-21 10:00:27 +02:00
lib.rs chore(trtllm): fmt 2024-10-21 10:00:27 +02:00
looper.rs feat(looper): minor optimizations to avoid growing too much the containers 2024-10-21 10:00:27 +02:00
main.rs chore(trtllm): post-rebase commit 2024-10-21 12:31:24 +02:00
utils.rs (ffi) encode the provided user prompt within each request thread 2024-10-21 10:00:27 +02:00