..
test_bloom_560m
feat(server): support vectorized warpers in flash causal lm ( #317 )
2023-05-26 12:30:27 +02:00
test_bloom_560m_sharded
feat(integration-tests): improve comparison and health checks ( #336 )
2023-05-16 20:22:11 +02:00
test_flash_awq
Add AWQ quantization inference support ( #1019 ) ( #1054 )
2023-09-25 15:31:27 +02:00
test_flash_awq_sharded
Add AWQ quantization inference support ( #1019 ) ( #1054 )
2023-09-25 15:31:27 +02:00
test_flash_falcon
feat(server): add retry on download ( #384 )
2023-05-31 10:57:53 +02:00
test_flash_gemma
feat: add support for Gemma ( #1583 )
2024-04-24 18:08:23 +03:00
test_flash_grammar_llama
fix: correctly index into mask when applying grammar ( #1618 )
2024-04-25 10:16:16 +03:00
test_flash_llama
Remove the stripping of the prefix space (and any other mangling that tokenizers might do). ( #1065 )
2023-09-27 12:13:45 +02:00
test_flash_llama_gptq
ROCm AWQ support ( #1514 )
2024-04-24 09:21:34 +00:00
test_flash_medusa
Speculative ( #1308 )
2024-04-18 12:39:39 +00:00
test_flash_mistral
feat: add mistral model ( #1071 )
2023-09-28 09:55:47 +02:00
test_flash_neox
fix(server): fix init for flash causal lm ( #352 )
2023-05-22 15:05:32 +02:00
test_flash_neox_sharded
fix(server): fix init for flash causal lm ( #352 )
2023-05-22 15:05:32 +02:00
test_flash_phi
feat: adds phi model ( #1442 )
2024-04-22 13:06:38 +03:00
test_flash_qwen2
feat: Qwen2 ( #1608 )
2024-04-25 09:21:22 +03:00
test_flash_santacoder
feat(integration-tests): improve comparison and health checks ( #336 )
2023-05-16 20:22:11 +02:00
test_flash_starcoder
feat(server): Rework model loading ( #344 )
2023-06-08 14:51:52 +02:00
test_flash_starcoder2
feat: starcoder2 ( #1605 )
2024-04-25 09:18:55 +03:00
test_flash_starcoder_gptq
ROCm AWQ support ( #1514 )
2024-04-24 09:21:34 +00:00
test_grammar_llama
fix: correctly index into mask when applying grammar ( #1618 )
2024-04-25 10:16:16 +03:00
test_idefics
Fixing non divisible embeddings. ( #1476 )
2024-04-22 12:48:59 +03:00
test_mamba
Improving mamba runtime by using updates ( #1552 )
2024-04-24 13:21:39 +03:00
test_mpt
feat(server): Add Non flash MPT. ( #514 )
2023-07-03 13:01:46 +02:00
test_mt0_base
feat(server): support vectorized warpers in flash causal lm ( #317 )
2023-05-26 12:30:27 +02:00
test_neox
feat(server): Rework model loading ( #344 )
2023-06-08 14:51:52 +02:00
test_neox_sharded
feat(server): Rework model loading ( #344 )
2023-06-08 14:51:52 +02:00
test_t5_sharded
feat(server): support fp16 for t5 ( #360 )
2023-05-23 18:16:48 +02:00
test_tools_llama
fix: improve tool type, bump pydantic and outlines ( #1650 )
2024-04-25 12:34:55 +03:00