Daniël de Kok 095775e05c launcher: correctly get the head dimension for VLMs (#3116) ... * launcher: correctly get the head dimension for VLMs For most (?) VLMs, the head dimension is in the `text_config` configuration section. However, since we only queried the top-level `head_dim` (which typically doesn't exist in VLMs), we would never use flashinfer. This change adds a method that gets the head dimension from the top-level `Config` struct or `text_config` when that fails. * fix: bump org name in gemma3 test --------- Co-authored-by: drbh <david.richard.holtz@gmail.com>		2025-03-17 18:19:37 +01:00
..
env_runtime.rs	Add Gaudi Backend (#3055)	2025-02-28 12:14:58 +01:00
gpu.rs	Remove compute capability lazy cell (#2580)	2024-09-30 08:48:47 +02:00
main.rs	launcher: correctly get the head dimension for VLMs (#3116)	2025-03-17 18:19:37 +01:00