huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 08:22:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
0d794af6a5
text-generation-inference/server/exllama_kernels/exllama_kernels/cuda_func
History
OlivierDehaene 0d794af6a5
feat: experimental support for cuda graphs (#1428) 
Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2024-02-12 10:09:29 +01:00
..
column_remap.cu feat(server): Add exllama GPTQ CUDA kernel support #553 (#666) 2023-07-21 10:59:00 +02:00
column_remap.cuh feat(server): Add exllama GPTQ CUDA kernel support #553 (#666) 2023-07-21 10:59:00 +02:00
q4_matmul.cu feat: experimental support for cuda graphs (#1428) 2024-02-12 10:09:29 +01:00
q4_matmul.cuh feat: experimental support for cuda graphs (#1428) 2024-02-12 10:09:29 +01:00
q4_matrix.cu feat: experimental support for cuda graphs (#1428) 2024-02-12 10:09:29 +01:00
q4_matrix.cuh feat(server): Add exllama GPTQ CUDA kernel support #553 (#666) 2023-07-21 10:59:00 +02:00