huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
8ee52e91f4
text-generation-inference/server/text_generation_server
History
Tiezhen WANG b07a2518d9 Update the link for qwen2 (#2068) 
* Update the link for qwen2

* Fix Qwen2 model URL in model table

* Fix too eager staging

---------

Co-authored-by: Daniël de Kok <me@danieldk.eu>
2024-09-24 03:43:30 +00:00
..
layers Add support for GPTQ Marlin (#2052) 2024-09-24 03:43:30 +00:00
models Update the link for qwen2 (#2068) 2024-09-24 03:43:30 +00:00
pb chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
utils Add support for GPTQ Marlin (#2052) 2024-09-24 03:43:30 +00:00
__init__.py feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00
cache.py fix(server): decrease memory fragmentation (#557) 2023-07-06 14:28:33 +02:00
cli.py ROCm and sliding windows fixes (#2033) 2024-09-24 03:42:29 +00:00
interceptor.py Aligin the source code with main branch 2.0.4 2024-09-24 03:06:55 +00:00
server.py ROCm and sliding windows fixes (#2033) 2024-09-24 03:42:29 +00:00
tracing.py feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00