text-generation-inference

huggingface/text-generation-inference

Fork 0

mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 15:32:08 +00:00

Commit Graph

Author SHA1 Message Date

Author	SHA1	Message	Date
Daniël de Kok	7be7ab7015	nix: support Python tokenizer conversion in the router (#2515 ) Ideally we wouldn't have the router wrapper that this change adds, but when I give PyO3 a Python interpreter with packages, it ends up linking libpython from the Python interpreter rather than the constructed environment and cannot pick up the Python modules as a result.	2024-09-25 06:15:35 +00:00
Daniël de Kok	a5af557359	nix: add `text-generation-benchmark` to pure devshell (#2431 ) nix: add text-generation-benchmark to pure devshell	2024-09-25 06:10:59 +00:00
Daniël de Kok	20ed7b598e	nix: try to reduce the number of Rust rebuilds (#2424 ) Try to reduce the number of router/launcher rebuilds by filtering sources. In this way, recompiles should only be triggered by changes in Cargo or Rust files.	2024-09-25 06:08:38 +00:00

Daniël de Kok

7be7ab7015

nix: support Python tokenizer conversion in the router (#2515 )

Ideally we wouldn't have the router wrapper that this change adds,
but when I give PyO3 a Python interpreter with packages, it ends
up linking libpython from the Python interpreter rather than the
constructed environment and cannot pick up the Python modules as
a result.

2024-09-25 06:15:35 +00:00

Daniël de Kok

a5af557359

nix: add text-generation-benchmark to pure devshell (#2431 )

nix: add text-generation-benchmark to pure devshell

2024-09-25 06:10:59 +00:00

Daniël de Kok

20ed7b598e

nix: try to reduce the number of Rust rebuilds (#2424 )

Try to reduce the number of router/launcher rebuilds by filtering
sources. In this way, recompiles should only be triggered by changes
in Cargo or Rust files.

2024-09-25 06:08:38 +00:00

3 Commits