text-generation-inference/backends/v2
OlivierDehaene 8c3669b287
feat: auto max_new_tokens (#2803)
* feat: auto max_new_tokens

* update default

* Fixing the tests.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2024-12-06 05:50:35 +01:00
..
src feat: auto max_new_tokens (#2803) 2024-12-06 05:50:35 +01:00
build.rs chore: Add old V2 backend (#2551) 2024-09-24 08:38:17 +02:00
Cargo.toml Hotfixing main (#2556) 2024-09-24 11:51:14 +02:00