huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,193 Commits 229 Branches 59 Tags 23 MiB
b653605e54
Commit Graph

9 Commits

Author SHA1 Message Date
Morgan Funtowicz
b653605e54 feat(trtllm): fix logits retrieval 2024-12-10 23:28:13 +01:00
Morgan Funtowicz
60059b6968 feat(trtllm): expose finish reason to Rust 2024-12-10 16:51:22 +01:00
Morgan Funtowicz
62530649b8 feat(backend): remove constexpig 2024-12-03 16:47:48 +01:00
Morgan Funtowicz
2f8634ec01 feat(backend): impl missing generation_step_t as return value of pull_tokens 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
fd7e2b5bbd feat(backend): more impl 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
25c6bbe142 feat(backend): introduce backend_workspace_t to store precomputed information from the engine folder 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
702dc9cd05 feat(backend): missing return statement 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
9bb6309712 feat(backend): added some logging 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
3a2698fb79 feat(backend): initial rewrite of the backend for simplicity 2024-12-03 09:43:03 +01:00