text-generation-inference/backends/v2
drbh eecca27113
feat: improve qwen2-vl startup (#2802)
* feat: tokenize each request individually and increase warmup image size

* feat: adjust rotary embed and avoid cuda graphs of size 2 and smaller

* fix: address image resize and rebase changes

* feat: update to run qwen2-vl tests

* fix: tweak param types
2025-01-17 11:50:41 -05:00
..
src feat: improve qwen2-vl startup (#2802) 2025-01-17 11:50:41 -05:00
build.rs chore: Add old V2 backend (#2551) 2024-09-24 08:38:17 +02:00
Cargo.toml chore: Update jsonschema to 0.28.0 (#2870) 2025-01-10 15:01:54 +01:00