huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-05-22 02:02:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
51a0b9d11c
text-generation-inference/backends/gaudi/server/text_generation_server
History
regisss f208ba6afc
Fix HF_HUB_OFFLINE=1 for Gaudi backend (#3193) 
* Fix `HF_HUB_OFFLINE=1` for Gaudi backend

* Fix HF cache default value in server.rs

* Format
2025-05-06 10:47:53 +02:00
..
adapters Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
layers Warmup gaudi backend (#3172) 2025-04-24 09:57:08 +02:00
models Fix HF_HUB_OFFLINE=1 for Gaudi backend (#3193) 2025-05-06 10:47:53 +02:00
pb Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
utils Hotfix gaudi2 with newer transformers. (#3176) 2025-04-15 12:39:28 +02:00
__init__.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cache.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cli.py Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu (#3113) 2025-04-14 15:58:13 +02:00
habana_quantization_env.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
interceptor.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
server.py Gaudi: clean cuda/rocm code in hpu backend, enable flat_hpu (#3113) 2025-04-14 15:58:13 +02:00
tgi_service.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tracing.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00