text-generation-inference/nix
drbh d6a0c67e2f
feat: add initial qwen2.5-vl model and test (#2971)
* feat: support qwen2.5 vl model

* fix: bump support models doc

* feat: check before rope type adjustment and small refactors

* fix: add transformer overlay for processor support

* fix: vendor processor and config from transformers

* fix: refactor/simplify conditionals
2025-02-19 12:38:20 +01:00
..
client.nix Stream options. (#2533) 2024-09-19 20:50:37 +02:00
crate-overrides.nix nix: support Python tokenizer conversion in the router (#2515) 2024-09-12 10:44:01 +02:00
docker.nix nix: experimental support for building a Docker container (#2470) 2024-10-01 18:02:06 +02:00
impure-shell.nix Use kernels from the kernel hub (#2988) 2025-02-10 19:19:25 +01:00
overlay.nix feat: add initial qwen2.5-vl model and test (#2971) 2025-02-19 12:38:20 +01:00
server.nix Use eetq kernel from the hub (#3029) 2025-02-18 10:03:53 +01:00