| .. |
|
custom_modeling
|
hotfix: mixtral
|
2024-04-25 17:51:46 +03:00 |
|
__init__.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
bloom.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
cache_manager.py
|
fix: fix CohereForAI/c4ai-command-r-plus (#1707)
|
2024-04-25 17:51:35 +03:00 |
|
causal_lm.py
|
fix: Handle concurrent grammar requests (#1610)
|
2024-04-25 10:11:40 +03:00 |
|
flash_causal_lm.py
|
fix: fix CohereForAI/c4ai-command-r-plus (#1707)
|
2024-04-25 17:51:35 +03:00 |
|
flash_cohere.py
|
fix: fix CohereForAI/c4ai-command-r-plus (#1707)
|
2024-04-25 17:51:35 +03:00 |
|
flash_dbrx.py
|
feat: Add dbrx support (#1685)
|
2024-04-25 14:07:28 +03:00 |
|
flash_gemma.py
|
feat: cohere (#1660)
|
2024-04-25 12:39:14 +03:00 |
|
flash_llama.py
|
Adding Llava-Next (Llava 1.6) with full support. (#1709)
|
2024-04-25 14:30:55 +00:00 |
|
flash_mistral.py
|
fix: fix CohereForAI/c4ai-command-r-plus (#1707)
|
2024-04-25 17:51:35 +03:00 |
|
flash_mixtral.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
flash_neox.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
flash_phi.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
flash_qwen2.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
flash_rw.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
flash_santacoder.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
flash_starcoder2.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
galactica.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
globals.py
|
Add cuda graphs sizes and make it default. (#1703)
|
2024-04-25 15:08:54 +03:00 |
|
gpt_neox.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
idefics_causal_lm.py
|
Adding Llava-Next (Llava 1.6) with full support. (#1709)
|
2024-04-25 14:30:55 +00:00 |
|
idefics.py
|
Fix idefics default. (#1614)
|
2024-04-25 10:12:13 +03:00 |
|
llava_next.py
|
Adding Llava-Next (Llava 1.6) with full support. (#1709)
|
2024-04-25 14:30:55 +00:00 |
|
mamba.py
|
Add cuda graphs sizes and make it default. (#1703)
|
2024-04-25 15:08:54 +03:00 |
|
model.py
|
feat: add more latency metrics in forward (#1346)
|
2024-04-19 13:41:34 +03:00 |
|
mpt.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
opt.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
phi.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
rw.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
santacoder.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
seq2seq_lm.py
|
feat: Qwen2 (#1608)
|
2024-04-25 09:21:22 +03:00 |
|
t5.py
|
Revamp medusa implementation so that every model can benefit. (#1588)
|
2024-04-25 09:13:03 +03:00 |
|
types.py
|
chore: add pre-commit (#1569)
|
2024-04-24 15:32:02 +03:00 |
|
vlm_causal_lm.py
|
Adding Llava-Next (Llava 1.6) with full support. (#1709)
|
2024-04-25 14:30:55 +00:00 |
