huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
e11f5f1c38
text-generation-inference/router/src
History
drbh e11f5f1c38
feat: implement a templated endpoint for visibility into chat requests (#2333) 
* feat: implement a templated endpoint for visibility into chat requests

* feat: improve to tokenize too

* fix: adjust return type

* feat: simplify prepare_chat_input logic and adjust start stop chars
2024-08-06 13:51:32 +02:00
..
infer Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
config.rs Fixing malformed rust tokenizers (#2134) 2024-06-27 16:04:03 +02:00
kserve.rs fix: simplify kserve endpoint and fix imports (#2119) 2024-06-25 19:30:10 -04:00
lib.rs feat: implement a templated endpoint for visibility into chat requests (#2333) 2024-08-06 13:51:32 +02:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
main.rs.back Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
server.rs feat: implement a templated endpoint for visibility into chat requests (#2333) 2024-08-06 13:51:32 +02:00
usage_stats.rs refactor usage stats (#2339) 2024-07-31 16:29:07 +02:00
validation.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00