huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-09 15:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
856 Commits 240 Branches 66 Tags 36 MiB
3597beefe2
Commit Graph

14 Commits

Author SHA1 Message Date
Morgan Funtowicz
2aac2ff2cd do the same name definition stuff for tensorrt_llm_executor_static 2024-07-22 11:32:54 +00:00
Morgan Funtowicz
da079df4cd simplify prebuilt trtllm libraries name definition 2024-07-22 11:32:31 +00:00
Morgan Funtowicz
20bcaea54f add some more information in CMakeLists.txt to correctly find and install nvrtc wrapper 2024-07-22 09:33:38 +00:00
Morgan Funtowicz
84153702d2 add some more information in CMakeLists.txt to correctly install executorWorker 2024-07-22 08:43:10 +00:00
Morgan Funtowicz
d5464d2f80 add initial Dockerfile for TRTLLM backend 2024-07-19 22:08:12 +00:00
Morgan Funtowicz
7784a21d48 impl RwLock scenario for TensorRtLllmBackend 2024-07-16 20:08:10 +00:00
Morgan Funtowicz
b846ae2d9e use external fmt lib 2024-07-12 19:24:59 +00:00
Morgan Funtowicz
6c92ebe6a8 update trtllm to latest version a96cccafcf6365c128f004f779160951f8c0801c 2024-07-10 13:47:56 +00:00
Morgan Funtowicz
7b9f92a0aa use spdlog release 1.14.1 moving forward 2024-07-10 13:47:31 +00:00
Morgan Funtowicz
f53ffa886d Specify which default log level to use depending on CMake build type 2024-07-08 22:06:49 +00:00
Morgan Funtowicz
4113d6d51b Move to latest TensorRT-LLM version 2024-07-08 22:06:30 +00:00
Morgan Funtowicz
f57f2a4521 First version loading engines and making it ready for inference 2024-07-03 21:12:24 +00:00
Morgan Funtowicz
f8a1463915 Enable end to end CMake build 2024-07-03 10:27:53 +02:00
Morgan Funtowicz
818162e0c2 Overall build TRTLLM and deps through CMake build system 2024-07-02 17:16:27 +02:00