text-generation-inference/backends/v2/src
Nicolas Patry 82c24f7420
Using both value from config as they might not be correct. (#2817)
* Using both value from config as they might not be correct.

* Fixing max_position_embeddings for falcon.

* Simple attempt to fix the healthcheck block allocation.

* Much simpler solution.

* Default value for Backend start_health
2024-12-10 19:37:09 +01:00
..
client chore: Add old V2 backend (#2551) 2024-09-24 08:38:17 +02:00
backend.rs Using both value from config as they might not be correct. (#2817) 2024-12-10 19:37:09 +01:00
lib.rs chore: Add old V2 backend (#2551) 2024-09-24 08:38:17 +02:00
main.rs feat: add payload limit (#2726) 2024-11-21 18:20:15 +00:00
queue.rs feat: auto max_new_tokens (#2803) 2024-12-06 05:50:35 +01:00