text-generation-inference/router/src
drbh 21187c27c9
fix: bump minijinja version and add test for llama 3.1 tools (#2463)
* fix: support tojson and avoid message indexing issue in template

* fix: prefer minijinja native methods and prefer workspace level dependency

* fix: adjust comment typo
2024-08-27 13:31:08 -04:00
..
infer fix: bump minijinja version and add test for llama 3.1 tools (#2463) 2024-08-27 13:31:08 -04:00
config.rs add gptj modeling in TGI #2366 (CI RUN) (#2372) 2024-08-07 21:32:37 -04:00
kserve.rs fix: simplify kserve endpoint and fix imports (#2119) 2024-06-25 19:30:10 -04:00
lib.rs Pr 2451 ci branch (#2454) 2024-08-26 20:19:38 -04:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
main.rs.back Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
server.rs Pr 2451 ci branch (#2454) 2024-08-26 20:19:38 -04:00
usage_stats.rs refactor usage stats (#2339) 2024-07-31 16:29:07 +02:00
validation.rs feat: validate template variables before apply and improve sliding wi… (#2403) 2024-08-12 10:58:40 -04:00