huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 07:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
59fd0cbdff
text-generation-inference/router/src
History
drbh 47d7e34458
fix: enable chat requests in vertex endpoint (#2481) 
* fix: enable chat requests in vertex endpoint

* feat: avoid unwrap and pre allocate future vec
2024-09-02 10:00:52 -04:00
..
infer Lots of improvements (Still 2 allocators) (#2449) 2024-08-29 16:29:01 +02:00
config.rs add gptj modeling in TGI #2366 (CI RUN) (#2372) 2024-08-07 21:32:37 -04:00
kserve.rs fix: simplify kserve endpoint and fix imports (#2119) 2024-06-25 19:30:10 -04:00
lib.rs fix: enable chat requests in vertex endpoint (#2481) 2024-09-02 10:00:52 -04:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
main.rs.back Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
server.rs fix: enable chat requests in vertex endpoint (#2481) 2024-09-02 10:00:52 -04:00
usage_stats.rs refactor usage stats (#2339) 2024-07-31 16:29:07 +02:00
validation.rs Lots of improvements (Still 2 allocators) (#2449) 2024-08-29 16:29:01 +02:00