mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-21 23:12:07 +00:00
ae37890eef
The neuron tests require models to have been previously exported and cached on the hub. This is done automatically by the neuron.model fixture the first time the tests are ran for a specific version. This fixture used to export the models using optimum-neuron directly, but this package is not necessarily present on the system. Instead, it is now done through the neuron TGI itself, since it contains all the tools required to export the models. Note that since the CI runs docker in docker (dind) it does not seem possible to share a volume between the CI container and the container used to export the model. For that reason, a specific image with a modified entrypoint is built on-the-fly when a model export is required. |
||
|---|---|---|
| .. | ||
| fixtures/neuron | ||
| images | ||
| models | ||
| neuron/integration | ||
| conftest.py | ||
| pyproject.toml | ||
| pytest.ini | ||
| requirements.txt | ||
| uv.lock | ||