huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-06-02 20:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,192 Commits 235 Branches 62 Tags 30 MiB
b9c04b9c07
Commit Graph

6 Commits

Author SHA1 Message Date
Morgan Funtowicz
5a85661661 feat(backend): rely on multi consumer queue to scheduler workers 2024-11-22 13:32:56 +01:00
Morgan Funtowicz
5335bf973b feat(backend): multistream inference on CPU 2024-11-21 00:03:05 +01:00
Morgan Funtowicz
188442f67d misc(lint): make clippy happier 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
e4d803c94e feat(backend): build and link through build.rs 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
52d57dca79 feat(llamacpp): initial end2end build 2024-11-14 08:42:01 +01:00
Morgan Funtowicz
aa1fcba59f feat(llamacpp): initial commit 
# Conflicts:
#	Cargo.lock
 2024-11-14 08:42:01 +01:00