mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-09 15:05:24 +00:00
79183d1647
* chore(neuron): bump version to 0.2.0 * refactor(neuron): use named parameters in inputs helpers This allows to hide the differences between the two backends in terms of input parameters. * refactor(neuron): remove obsolete code paths * fix(neuron): use neuron_config whenever possible * fix(neuron): use new cache import path * fix(neuron): neuron config is not stored in config anymore * fix(nxd): adapt model retrieval to new APIs * fix(generator): emulate greedy in sampling parameters When on-device sampling is enabled, we need to emulate the greedy behaviour using top-k=1, top-p=1, temperature=1. * test(neuron): update models and expectations * feat(neuron): support on-device sampling * fix(neuron): adapt entrypoint * tests(neuron): remove obsolete models * fix(neuron): adjust test expectations for llama on nxd |
||
|---|---|---|
| .. | ||
| fixtures/neuron | ||
| images | ||
| models | ||
| neuron | ||
| conftest.py | ||
| pyproject.toml | ||
| pytest.ini | ||
| requirements.txt | ||
| uv.lock | ||