text-generation-inference

huggingface/text-generation-inference

Fork 0

mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-11-18 23:15:59 +00:00

Commit Graph

Author SHA1 Message Date

Author	SHA1	Message	Date
Daniël de Kok	94304649f1	nix: support Python tokenizer conversion in the router (#2515 ) Ideally we wouldn't have the router wrapper that this change adds, but when I give PyO3 a Python interpreter with packages, it ends up linking libpython from the Python interpreter rather than the constructed environment and cannot pick up the Python modules as a result.	2024-09-12 10:44:01 +02:00
Daniël de Kok	9474415095	nix: add `text-generation-benchmark` to pure devshell (#2431 ) nix: add text-generation-benchmark to pure devshell	2024-08-21 07:48:13 +02:00
Daniël de Kok	1411bfb989	nix: try to reduce the number of Rust rebuilds (#2424 ) Try to reduce the number of router/launcher rebuilds by filtering sources. In this way, recompiles should only be triggered by changes in Cargo or Rust files.	2024-08-16 10:01:01 +02:00

Daniël de Kok

94304649f1

nix: support Python tokenizer conversion in the router (#2515 )

Ideally we wouldn't have the router wrapper that this change adds,
but when I give PyO3 a Python interpreter with packages, it ends
up linking libpython from the Python interpreter rather than the
constructed environment and cannot pick up the Python modules as
a result.

2024-09-12 10:44:01 +02:00

Daniël de Kok

9474415095

nix: add text-generation-benchmark to pure devshell (#2431 )

nix: add text-generation-benchmark to pure devshell

2024-08-21 07:48:13 +02:00

Daniël de Kok

1411bfb989

nix: try to reduce the number of Rust rebuilds (#2424 )

Try to reduce the number of router/launcher rebuilds by filtering
sources. In this way, recompiles should only be triggered by changes
in Cargo or Rust files.

2024-08-16 10:01:01 +02:00

3 Commits