huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-10-09 15:05:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
858 Commits 240 Branches 66 Tags 36 MiB
40330c73f0
Commit Graph

10 Commits

Author SHA1 Message Date
Morgan Funtowicz
40330c73f0 align all the linker search dependency 2024-07-22 14:14:57 +00:00
Morgan Funtowicz
6a9e925ec1 fix bad copy/past missing nvinfer linkage direction 2024-07-22 11:43:10 +00:00
Morgan Funtowicz
3597beefe2 leverage pkg-config to probe libraries paths and reuse new install structure from cmake 2024-07-22 11:39:11 +00:00
Morgan Funtowicz
d5464d2f80 add initial Dockerfile for TRTLLM backend 2024-07-19 22:08:12 +00:00
Morgan Funtowicz
7784a21d48 impl RwLock scenario for TensorRtLllmBackend 2024-07-16 20:08:10 +00:00
Morgan Funtowicz
518d9a9e0b make sure to track include/ffi.h to trigger rebuild from cargo 2024-07-12 19:26:04 +00:00
Morgan Funtowicz
5aede911f8 include guard to build example in cmakelists 2024-07-11 21:24:01 +00:00
Morgan Funtowicz
f8a1463915 Enable end to end CMake build 2024-07-03 10:27:53 +02:00
Morgan Funtowicz
47ac5c654d Working FFI call for TGI and TRTLLM backend 2024-07-01 15:53:23 +02:00
Morgan Funtowicz
dc402dc9ac Initial setup for CXX binding to TRTLLM 2024-06-30 23:37:20 +02:00