huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-19 13:52:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
eecca27113
text-generation-inference/backends
History
drbh eecca27113
feat: improve qwen2-vl startup (#2802) 
* feat: tokenize each request individually and increase warmup image size

* feat: adjust rotary embed and avoid cuda graphs of size 2 and smaller

* fix: address image resize and rebase changes

* feat: update to run qwen2-vl tests

* fix: tweak param types
2025-01-17 11:50:41 -05:00
..
client feat: improve qwen2-vl startup (#2802) 2025-01-17 11:50:41 -05:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
trtllm fix: lint backend and doc files (#2850) 2024-12-16 16:12:34 -05:00
v2 feat: improve qwen2-vl startup (#2802) 2025-01-17 11:50:41 -05:00
v3 feat: improve qwen2-vl startup (#2802) 2025-01-17 11:50:41 -05:00