huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-26 12:32:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
eecca27113
text-generation-inference/backends/v3/src
History
drbh eecca27113
feat: improve qwen2-vl startup (#2802) 
* feat: tokenize each request individually and increase warmup image size

* feat: adjust rotary embed and avoid cuda graphs of size 2 and smaller

* fix: address image resize and rebase changes

* feat: update to run qwen2-vl tests

* fix: tweak param types
2025-01-17 11:50:41 -05:00
..
client feat: improve qwen2-vl startup (#2802) 2025-01-17 11:50:41 -05:00
backend.rs Using both value from config as they might not be correct. (#2817) 2024-12-10 19:37:09 +01:00
block_allocator.rs Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
lib.rs Choosing input/total tokens automatically based on available VRAM? (#2673) 2024-10-28 04:59:49 +01:00
main.rs feat: add payload limit (#2726) 2024-11-21 18:20:15 +00:00
queue.rs Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
radix.rs Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00