huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
5da4cfab1c
text-generation-inference/server/text_generation_server/models
History
Wang, Yi 5da4cfab1c
refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 
* refine get xpu free memory

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable qwen2 in xpu

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

* enable gemma/gemma2/phi in intel platform

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

---------

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
2024-07-01 14:32:54 +02:00
..
custom_modeling fix: use weights from base_layer (#2141) 2024-07-01 12:58:40 +02:00
__init__.py Fixing gemma2. (#2135) 2024-06-27 16:04:20 +02:00
bloom.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
causal_lm.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_causal_lm.py Fixing gemma2. (#2135) 2024-06-27 16:04:20 +02:00
flash_cohere.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_dbrx.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_gemma2.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-07-01 14:32:54 +02:00
flash_gemma.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-07-01 14:32:54 +02:00
flash_gpt2.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_llama.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_mistral.py fix AttributeError: 'MixtralLayer' object has no attribute 'mlp' (#2123) 2024-07-01 14:17:22 +02:00
flash_mixtral.py MLPSpeculator. (#1865) 2024-05-14 12:33:18 +02:00
flash_neox.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_phi.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-07-01 14:32:54 +02:00
flash_qwen2.py refine get xpu free memory/enable Qwen2/gemma2/gemma/phi in intel platform (#2132) 2024-07-01 14:32:54 +02:00
flash_rw.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_santacoder.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
flash_starcoder2.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
galactica.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
globals.py Fixing gemma2. (#2135) 2024-06-27 16:04:20 +02:00
gpt_neox.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
idefics2.py MLPSpeculator. (#1865) 2024-05-14 12:33:18 +02:00
idefics_causal_lm.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
idefics.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
llava_next.py MLPSpeculator. (#1865) 2024-05-14 12:33:18 +02:00
mamba.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
model.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
mpt.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
opt.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
pali_gemma.py Idefics2: sync added image tokens with transformers (#2080) 2024-06-27 15:54:35 +02:00
phi.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
rw.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
santacoder.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
seq2seq_lm.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
t5.py Enable multiple LoRa adapters (#2010) 2024-06-25 14:46:27 -04:00
types.py chore: add pre-commit (#1569) 2024-02-16 11:58:58 +01:00
vlm_causal_lm.py Idefics2: sync added image tokens with transformers (#2080) 2024-06-27 15:54:35 +02:00