text-generation-inference/backends/v3
Nicolas Patry 82c24f7420
Using both value from config as they might not be correct. (#2817)
* Using both value from config as they might not be correct.

* Fixing max_position_embeddings for falcon.

* Simple attempt to fix the healthcheck block allocation.

* Much simpler solution.

* Default value for Backend start_health
2024-12-10 19:37:09 +01:00
..
benches Keeping the benchmark somewhere (#2401) 2024-08-12 15:22:02 +02:00
src Using both value from config as they might not be correct. (#2817) 2024-12-10 19:37:09 +01:00
build.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
Cargo.toml fix: bump minijinja version and add test for llama 3.1 tools (#2463) 2024-08-27 13:31:08 -04:00