huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-07 02:02:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,225 Commits 228 Branches 59 Tags 26 MiB
0863dd1533
Commit Graph

3 Commits

Author SHA1 Message Date
drbh
8f6146f11a
Revert "feat: improve qwen2-vl startup " (#2924) 
Revert "feat: improve qwen2-vl startup  (#2802)"

This reverts commit eecca27113.
 2025-01-17 12:09:05 -05:00
drbh
eecca27113
feat: improve qwen2-vl startup (#2802) 
* feat: tokenize each request individually and increase warmup image size

* feat: adjust rotary embed and avoid cuda graphs of size 2 and smaller

* fix: address image resize and rebase changes

* feat: update to run qwen2-vl tests

* fix: tweak param types
 2025-01-17 11:50:41 -05:00
OlivierDehaene
10e6f29295
chore: Add old V2 backend (#2551) 
* wip

* added v2
 2024-09-24 08:38:17 +02:00