| .. |
|
custom_kernels
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
exllama_kernels
|
feat: add cuda memory fraction (#659)
|
2023-07-24 11:43:58 +02:00 |
|
exllamav2_kernels
|
Exllama v2 (#1211)
|
2023-11-25 22:38:38 +01:00 |
|
tests
|
Fix test_pass_through_tokenizer (#117)
|
2024-04-09 09:30:47 +02:00 |
|
text_generation_server
|
Add Habana copyright header (#122)
|
2024-04-08 18:06:21 +02:00 |
|
.gitignore
|
Support eetq weight only quantization (#1068)
|
2023-09-27 11:42:57 +02:00 |
|
Makefile
|
Merge tag 'v1.2.0' into v1.2-release
|
2023-12-06 18:46:16 +01:00 |
|
Makefile-awq
|
Add AWQ quantization inference support (#1019) (#1054)
|
2023-09-25 15:31:27 +02:00 |
|
Makefile-eetq
|
Support eetq weight only quantization (#1068)
|
2023-09-27 11:42:57 +02:00 |
|
Makefile-flash-att
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
Makefile-flash-att-v2
|
make install-flash-attn-v2-cuda should work like make install-flash-attn-v2 used to work. (#1294)
|
2023-11-28 16:28:40 +01:00 |
|
Makefile-vllm
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
poetry.lock
|
Update dependencies (#69)
|
2024-02-25 13:07:47 +01:00 |
|
pyproject.toml
|
Update dependencies (#69)
|
2024-02-25 13:07:47 +01:00 |
|
README.md
|
feat(router): refactor API and add openAPI schemas (#53)
|
2023-02-03 12:43:37 +01:00 |
|
requirements_common.txt
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
requirements_cuda.txt
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
requirements_rocm.txt
|
Add RoCm support (#1243)
|
2023-11-27 14:08:12 +01:00 |
|
requirements.txt
|
Update dependencies (#69)
|
2024-02-25 13:07:47 +01:00 |
