huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-26 20:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
6265956bc4
text-generation-inference/server/text_generation_server/models
History
Wang, Yi 6265956bc4 refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 
* refine get xpu free memory

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable qwen2 in xpu

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable gemma/gemma2/phi in intel platform

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
2024-09-24 03:57:32 +00:00
..
custom_modeling fix: use weights from base_layer (#2141) 2024-09-24 03:57:32 +00:00
__init__.py Fixing gemma2. (#2135) 2024-09-24 03:57:07 +00:00
bloom.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
causal_lm.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_causal_lm.py Fixing gemma2. (#2135) 2024-09-24 03:57:07 +00:00
flash_cohere.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_dbrx.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_gemma2.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-09-24 03:57:32 +00:00
flash_gemma.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-09-24 03:57:32 +00:00
flash_gpt2.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_llama.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_mistral.py fix AttributeError: 'MixtralLayer' object has no attribute 'mlp' (#2123) 2024-09-24 03:57:32 +00:00
flash_mixtral.py MLPSpeculator. (#1865) 2024-07-17 05:36:58 +00:00
flash_neox.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_phi.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-09-24 03:57:32 +00:00
flash_qwen2.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-09-24 03:57:32 +00:00
flash_rw.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_santacoder.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
flash_starcoder2.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
galactica.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
globals.py Fixing gemma2. (#2135) 2024-09-24 03:57:07 +00:00
gpt_neox.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
idefics2.py MLPSpeculator. (#1865) 2024-07-17 05:36:58 +00:00
idefics_causal_lm.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
idefics.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
llava_next.py MLPSpeculator. (#1865) 2024-07-17 05:36:58 +00:00
mamba.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
model.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
mpt.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
opt.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
pali_gemma.py Idefics2: sync added image tokens with transformers (#2080) 2024-09-24 03:56:28 +00:00
phi.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
rw.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
santacoder.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
seq2seq_lm.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
t5.py Enable multiple LoRa adapters (#2010) 2024-09-24 03:55:04 +00:00
types.py chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
vlm_causal_lm.py Idefics2: sync added image tokens with transformers (#2080) 2024-09-24 03:56:28 +00:00