mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-21 09:42:09 +00:00
533eee50dc
* forward and tokenize chooser use the same shape concate or filter happened to cpu tensor to avoid dynamic shape in hpu Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> * use hpu set seed Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> --------- Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> |
||
|---|---|---|
| .. | ||
| integration-tests | ||
| text_generation_server | ||
| .gitignore | ||
| dill-0.3.7-patch.sh | ||
| dill-0.3.8-patch.sh | ||
| Makefile | ||
| Makefile-awq | ||
| Makefile-eetq | ||
| Makefile-fbgemm | ||
| Makefile-flash-att | ||
| Makefile-flash-att-v2 | ||
| Makefile-selective-scan | ||
| Makefile-vllm | ||
| poetry.lock | ||
| pyproject.toml | ||
| README.md | ||
| requirements.txt | ||
Text Generation Inference Python gRPC Server
A Python gRPC server for Text Generation Inference
Install
make install
Run
make run-dev