15 Commits

Author	SHA1	Message	Date
Morgan Funtowicz	fcbf2fc1ac	fix envvar CARGO_CFG_TARGET_ARCH set at runtime vs compile time	2024-07-25 10:36:55 +00:00
Morgan Funtowicz	dda015f2aa	add some custom stuff for nccl linkage	2024-07-25 10:29:51 +00:00
Morgan Funtowicz	48315e2608	clean up a bit	2024-07-24 09:52:38 +00:00
Morgan Funtowicz	9c60c9ca43	add missing dependant libraries for linking	2024-07-24 09:29:24 +00:00
Morgan Funtowicz	09bcca6a97	update build.rs to link to cuda 12.5	2024-07-24 07:50:26 +00:00
Morgan Funtowicz	40330c73f0	align all the linker search dependency	2024-07-22 14:14:57 +00:00
Morgan Funtowicz	6a9e925ec1	fix bad copy/past missing nvinfer linkage direction	2024-07-22 11:43:10 +00:00
Morgan Funtowicz	3597beefe2	leverage pkg-config to probe libraries paths and reuse new install structure from cmake	2024-07-22 11:39:11 +00:00
Morgan Funtowicz	d5464d2f80	add initial Dockerfile for TRTLLM backend	2024-07-19 22:08:12 +00:00
Morgan Funtowicz	7784a21d48	impl RwLock scenario for TensorRtLllmBackend	2024-07-16 20:08:10 +00:00
Morgan Funtowicz	518d9a9e0b	make sure to track include/ffi.h to trigger rebuild from cargo	2024-07-12 19:26:04 +00:00
Morgan Funtowicz	5aede911f8	include guard to build example in cmakelists	2024-07-11 21:24:01 +00:00
Morgan Funtowicz	f8a1463915	Enable end to end CMake build	2024-07-03 10:27:53 +02:00
Morgan Funtowicz	47ac5c654d	Working FFI call for TGI and TRTLLM backend	2024-07-01 15:53:23 +02:00
Morgan Funtowicz	dc402dc9ac	Initial setup for CXX binding to TRTLLM	2024-06-30 23:37:20 +02:00