text-generation-inference/router/src/infer
drbh 1f8c0f83e3 Pr 2395 ci run (#2406)
* fix(router): Fix appending to message content

* feat: add message and chat template test

---------

Co-authored-by: Simone Rossi <simone.rossi.93@gmail.com>
2024-09-25 06:06:17 +00:00
..
v2 Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385) 2024-09-25 06:04:51 +00:00
chat_template.rs Pr 2395 ci run (#2406) 2024-09-25 06:06:17 +00:00
mod.rs feat: validate template variables before apply and improve sliding wi… (#2403) 2024-09-25 06:05:43 +00:00
tool_grammar.rs Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00