hf_text-generation-inference

Commit Graph

Author	SHA1	Message	Date
Daniël de Kok	94304649f1	nix: support Python tokenizer conversion in the router (#2515 ) Ideally we wouldn't have the router wrapper that this change adds, but when I give PyO3 a Python interpreter with packages, it ends up linking libpython from the Python interpreter rather than the constructed environment and cannot pick up the Python modules as a result.	2024-09-12 10:44:01 +02:00
Daniël de Kok	9474415095	nix: add `text-generation-benchmark` to pure devshell (#2431 ) nix: add text-generation-benchmark to pure devshell	2024-08-21 07:48:13 +02:00
Daniël de Kok	1411bfb989	nix: try to reduce the number of Rust rebuilds (#2424 ) Try to reduce the number of router/launcher rebuilds by filtering sources. In this way, recompiles should only be triggered by changes in Cargo or Rust files.	2024-08-16 10:01:01 +02:00

Author

SHA1

Message

Date

Daniël de Kok

94304649f1

nix: support Python tokenizer conversion in the router (#2515 )

Ideally we wouldn't have the router wrapper that this change adds,
but when I give PyO3 a Python interpreter with packages, it ends
up linking libpython from the Python interpreter rather than the
constructed environment and cannot pick up the Python modules as
a result.

2024-09-12 10:44:01 +02:00

Daniël de Kok

9474415095

nix: add `text-generation-benchmark` to pure devshell (#2431 )

nix: add text-generation-benchmark to pure devshell

2024-08-21 07:48:13 +02:00

Daniël de Kok

1411bfb989

nix: try to reduce the number of Rust rebuilds (#2424 )

Try to reduce the number of router/launcher rebuilds by filtering
sources. In this way, recompiles should only be triggered by changes
in Cargo or Rust files.

2024-08-16 10:01:01 +02:00

3 Commits