text-generation-inference/router/src
drbh 1f8c0f83e3 Pr 2395 ci run (#2406)
* fix(router): Fix appending to message content

* feat: add message and chat template test

---------

Co-authored-by: Simone Rossi <simone.rossi.93@gmail.com>
2024-09-25 06:06:17 +00:00
..
infer Pr 2395 ci run (#2406) 2024-09-25 06:06:17 +00:00
config.rs add gptj modeling in TGI #2366 (CI RUN) (#2372) 2024-09-25 05:55:39 +00:00
kserve.rs fix: simplify kserve endpoint and fix imports (#2119) 2024-09-24 03:55:04 +00:00
lib.rs Pr 2395 ci run (#2406) 2024-09-25 06:06:17 +00:00
logging.rs Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00
main.rs.back Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00
server.rs fix: improve completions to send a final chunk with usage details (#2336) 2024-09-25 06:06:17 +00:00
usage_stats.rs refactor usage stats (#2339) 2024-09-25 05:55:39 +00:00
validation.rs feat: validate template variables before apply and improve sliding wi… (#2403) 2024-09-25 06:05:43 +00:00