huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,212 Commits 228 Branches 59 Tags 47 MiB
182ffaf064
Commit Graph

8 Commits

Author SHA1 Message Date
Morgan Funtowicz
50c376612c feat(backend): bind thread and memory affinity for thread 2024-11-21 13:52:38 +01:00
Morgan Funtowicz
5335bf973b feat(backend): multistream inference on CPU 2024-11-21 00:03:05 +01:00
Morgan Funtowicz
23d2bcf28d misc(build): improve build process 2024-11-14 09:38:13 +01:00
Morgan Funtowicz
cf17928f83 misc(cmake): remove dependency on fmt 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
62dba1a878 misc(cmake): use url deps and not git repo 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
52d57dca79 feat(llamacpp): initial end2end build 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
7d1f8a2bd6 feat(llamacpp): correctly handle CMAKE_BUILD_TYPE for spdlog macros 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
aa1fcba59f feat(llamacpp): initial commit 
# Conflicts:
#	Cargo.lock
 2024-11-14 08:42:01 +01:00