text-generation-inference/backends/gaudi/server/text_generation_server
Yuan Wu f5f14dc660
Gaudi: Fix llava-next and mllama crash issue (#3127)
Signed-off-by: yuanwu <yuan.wu@intel.com>
2025-03-25 15:08:15 +01:00
..
adapters Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
layers Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
models Gaudi: Fix llava-next and mllama crash issue (#3127) 2025-03-25 15:08:15 +01:00
pb Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
utils Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
__init__.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cache.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
cli.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
habana_quantization_env.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
interceptor.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
server.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tgi_service.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
tracing.py Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00