huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 07:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
1f70bb75e3
text-generation-inference/server/text_generation_server/layers/attention
History
Wang, Yi 0d879fe66e Cpu tgi (#1936) 
* add CPU tgi support

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* ipex distributed ops support

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: Funtowicz Morgan <mfuntowicz@users.noreply.github.com>
2024-09-24 03:51:26 +00:00
..
__init__.py Cpu tgi (#1936) 2024-09-24 03:51:26 +00:00
cuda.py Purely refactors paged/attention into layers/attention and make hardware differences more obvious with 1 file per hardware. (#1986) 2024-09-24 03:19:39 +00:00
flash_attn_triton.py Purely refactors paged/attention into layers/attention and make hardware differences more obvious with 1 file per hardware. (#1986) 2024-09-24 03:19:39 +00:00
rocm.py ROCm and sliding windows fixes (#2033) 2024-09-24 03:42:29 +00:00
xpu.py Cpu tgi (#1936) 2024-09-24 03:51:26 +00:00