huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,178 Commits 227 Branches 59 Tags 47 MiB
2f8634ec01
Commit Graph

6 Commits

Author SHA1 Message Date
Morgan Funtowicz
2f8634ec01 feat(backend): impl missing generation_step_t as return value of pull_tokens 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
a7bad25c41 feat(backend): fix backend_exception_t -> backend_error_t naming 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
fd7e2b5bbd feat(backend): more impl 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
25c6bbe142 feat(backend): introduce backend_workspace_t to store precomputed information from the engine folder 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
9bb6309712 feat(backend): added some logging 2024-12-03 09:43:03 +01:00
Morgan Funtowicz
3a2698fb79 feat(backend): initial rewrite of the backend for simplicity 2024-12-03 09:43:03 +01:00