huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
5cd1c93cad
text-generation-inference/backends/gaudi/server/text_generation_server
History
Wang, Yi A 5cd1c93cad add moe support, fix qwen/mistral/mixtral crash 
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
2025-03-18 00:45:15 -07:00
..
adapters Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
layers add moe support, fix qwen/mistral/mixtral crash 2025-03-18 00:45:15 -07:00
models add moe support, fix qwen/mistral/mixtral crash 2025-03-18 00:45:15 -07:00
pb Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
utils clean cuda/rocm code in hpu backend, enable flat_hpu 2025-03-14 01:25:31 -07:00
__init__.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cache.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cli.py fix TP in pageattn 2025-03-14 18:01:58 -07:00
habana_quantization_env.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
interceptor.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
server.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tgi_service.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tracing.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00