huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-06-17 06:42:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
9c739651cd
text-generation-inference/router/src/infer
History
drbh 0d06aed02d
feat: add guideline to chat request and template (#2391) 
* feat: add guideline to chat request and template

* fix: add template test and update docs
2024-08-09 10:56:45 -04:00
..
v2 Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385) 2024-08-09 16:41:17 +02:00
chat_template.rs feat: add guideline to chat request and template (#2391) 2024-08-09 10:56:45 -04:00
mod.rs feat: add guideline to chat request and template (#2391) 2024-08-09 10:56:45 -04:00
tool_grammar.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00