huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-29 10:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
959add5e9b
text-generation-inference/router/src/infer
History
drbh 959add5e9b feat: add guideline to chat request and template (#2391) 
* feat: add guideline to chat request and template

* fix: add template test and update docs
2024-09-25 06:04:51 +00:00
..
v2 Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385) 2024-09-25 06:04:51 +00:00
chat_template.rs feat: add guideline to chat request and template (#2391) 2024-09-25 06:04:51 +00:00
mod.rs feat: add guideline to chat request and template (#2391) 2024-09-25 06:04:51 +00:00
tool_grammar.rs Rebase TRT-llm (#2331) 2024-09-25 05:55:39 +00:00