huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-11 16:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
873 Commits 240 Branches 66 Tags 36 MiB
9c60c9ca43
Commit Graph

11 Commits

Author SHA1 Message Date
Morgan Funtowicz
03935f6705 update TensorRT-LLM to latest version 2024-07-23 22:13:02 +00:00
Morgan Funtowicz
3c39ab5ac8 fix typo 2024-07-23 08:11:36 +00:00
Morgan Funtowicz
4c657ca158 make docker linter happy with same capitalization rule 2024-07-23 07:42:31 +00:00
Morgan Funtowicz
ff151b738b refactored docker image 2024-07-23 07:34:40 +00:00
Morgan Funtowicz
805e584b92 update tgi entrypoint 2024-07-22 19:13:01 +00:00
Morgan Funtowicz
d0a34a95f2 adding missing ld_library_path for cuda stubs in Dockerfile 2024-07-22 15:16:39 +00:00
Morgan Funtowicz
3fd2bb70c3 fix missing / before tgi lib path 2024-07-22 14:57:03 +00:00
Morgan Funtowicz
a32ef3b875 correctly setup linking search path for runtime layer 2024-07-22 14:42:43 +00:00
Morgan Funtowicz
fd06ca6e7e add missing pkgconfig folder for MPI in Dockerfile 2024-07-22 14:20:06 +00:00
Morgan Funtowicz
40330c73f0 align all the linker search dependency 2024-07-22 14:14:57 +00:00
Morgan Funtowicz
d5464d2f80 add initial Dockerfile for TRTLLM backend 2024-07-19 22:08:12 +00:00