huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
a84da5b698
text-generation-inference/backends/gaudi/server/text_generation_server/utils
History
Wang, Yi A 9914ffe1f1 remove unused quantization code and enable awq/gptq int4 
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
2025-03-22 19:37:20 -07:00
..
merges Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
__init__.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
adapter.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
chunks.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
convert.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
debug.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
dist.py clean cuda/rocm code in hpu backend, enable flat_hpu 2025-03-14 01:25:31 -07:00
hub.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
import_utils.py clean cuda/rocm code in hpu backend, enable flat_hpu 2025-03-14 01:25:31 -07:00
kernels.py clean cuda/rocm code in hpu backend, enable flat_hpu 2025-03-14 01:25:31 -07:00
log.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
logits_process.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
peft.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
prefill_chunking.py adjust warmup and enable vlm 2025-03-20 23:12:52 -07:00
quantization.py remove unused quantization code and enable awq/gptq int4 2025-03-22 19:37:20 -07:00
segments.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
sgmv.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
speculate.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tokens.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
version.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
watermark.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
weights.py clean cuda/rocm code in hpu backend, enable flat_hpu 2025-03-14 01:25:31 -07:00