mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-24 16:32:12 +00:00
remove model where pageattn is not used, set block table to None since it's not used Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> |
||
---|---|---|
.. | ||
client | ||
gaudi | ||
grpc-metadata | ||
llamacpp | ||
neuron | ||
trtllm | ||
v2 | ||
v3 |