huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
main
text-generation-inference/backends/gaudi/server/requirements.txt

102 lines
8.5 KiB
Plaintext
Raw Permalink Normal View History

Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
accelerate==0.33.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
annotated-types==0.7.0 ; python_version >= "3.9" and python_version < "3.13"
attrs==25.3.0 ; python_version >= "3.9" and python_version < "3.13"
certifi==2025.1.31 ; python_version >= "3.9" and python_version < "3.13"
charset-normalizer==3.4.1 ; python_version >= "3.9" and python_version < "3.13"
click==8.1.8 ; python_version >= "3.9" and python_version < "3.13"
cloudpickle==3.1.1 ; python_version >= "3.9" and python_version < "3.13"
colorama==0.4.6 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Windows" or python_version >= "3.9" and python_version < "3.13" and sys_platform == "win32"
deprecated==1.2.18 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
diffusers==0.31.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
diskcache==5.6.3 ; python_version >= "3.9" and python_version < "3.13"
filelock==3.18.0 ; python_version >= "3.9" and python_version < "3.13"
fsspec==2025.3.2 ; python_version >= "3.9" and python_version < "3.13"
googleapis-common-protos==1.70.0 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
grpc-interceptor==0.15.4 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
grpcio-reflection==1.71.0 ; python_version >= "3.9" and python_version < "3.13"
grpcio-status==1.71.0 ; python_version >= "3.9" and python_version < "3.13"
grpcio==1.72.0rc1 ; python_version >= "3.9" and python_version < "3.13"
hf-transfer==0.1.9 ; python_version >= "3.9" and python_version < "3.13"
huggingface-hub==0.30.2 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
idna==3.10 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
importlib-metadata==8.6.1 ; python_version >= "3.9" and python_version < "3.13"
interegular==0.3.3 ; python_version >= "3.9" and python_version < "3.13"
jinja2==3.1.6 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
joblib==1.4.2 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
jsonschema-specifications==2024.10.1 ; python_version >= "3.9" and python_version < "3.13"
jsonschema==4.23.0 ; python_version >= "3.9" and python_version < "3.13"
lark==1.2.2 ; python_version >= "3.9" and python_version < "3.13"
llvmlite==0.43.0 ; python_version >= "3.9" and python_version < "3.13"
loguru==0.7.3 ; python_version >= "3.9" and python_version < "3.13"
markdown-it-py==3.0.0 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
markupsafe==3.0.2 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
mdurl==0.1.2 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
mpmath==1.3.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
nest-asyncio==1.6.0 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
networkx==3.2.1 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
numba==0.60.0 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
numpy==1.26.4 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
nvidia-cublas-cu12==12.4.5.8 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cuda-cupti-cu12==12.4.127 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cuda-nvrtc-cu12==12.4.127 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cuda-runtime-cu12==12.4.127 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cudnn-cu12==9.1.0.70 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cufft-cu12==11.2.1.3 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-curand-cu12==10.3.5.147 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cusolver-cu12==11.6.1.9 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cusparse-cu12==12.3.1.170 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-cusparselt-cu12==0.6.2 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-nccl-cu12==2.21.5 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-nvjitlink-cu12==12.4.127 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
nvidia-nvtx-cu12==12.4.127 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
opentelemetry-api==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-exporter-otlp-proto-common==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-exporter-otlp-proto-grpc==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-exporter-otlp-proto-http==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-exporter-otlp==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-instrumentation-grpc==0.53b0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-instrumentation==0.53b0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-proto==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-sdk==1.32.0 ; python_version >= "3.9" and python_version < "3.13"
opentelemetry-semantic-conventions==0.53b0 ; python_version >= "3.9" and python_version < "3.13"
Hotfixing gaudi deps. (#3174)
2025-04-15 09:55:28 +00:00
optimum-habana==1.17.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
optimum==1.24.0 ; python_version >= "3.9" and python_version < "3.13"
outlines==0.0.36 ; python_version >= "3.9" and python_version < "3.13"
packaging==24.2 ; python_version >= "3.9" and python_version < "3.13"
Hotfixing gaudi deps. (#3174)
2025-04-15 09:55:28 +00:00
peft==0.15.1 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
pillow==11.2.1 ; python_version >= "3.9" and python_version < "3.13"
prometheus-client==0.21.1 ; python_version >= "3.9" and python_version < "3.13"
protobuf==5.29.4 ; python_version >= "3.9" and python_version < "3.13"
psutil==7.0.0 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
py-cpuinfo==9.0.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
pydantic-core==2.33.1 ; python_version >= "3.9" and python_version < "3.13"
pydantic==2.11.3 ; python_version >= "3.9" and python_version < "3.13"
pygments==2.19.1 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
pyyaml==6.0.2 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
referencing==0.36.2 ; python_version >= "3.9" and python_version < "3.13"
regex==2024.11.6 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
requests==2.32.3 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
rich==14.0.0 ; python_version >= "3.9" and python_version < "3.13"
rpds-py==0.24.0 ; python_version >= "3.9" and python_version < "3.13"
safetensors==0.5.3 ; python_version >= "3.9" and python_version < "3.13"
scikit-learn==1.6.1 ; python_version >= "3.9" and python_version < "3.13"
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes
2025-02-28 11:14:58 +00:00
scipy==1.13.1 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
sentence-transformers==3.3.1 ; python_version >= "3.9" and python_version < "3.13"
sentencepiece==0.2.0 ; python_version >= "3.9" and python_version < "3.13"
setuptools==78.1.0 ; python_version >= "3.12" and python_version < "3.13"
shellingham==1.5.4 ; python_version >= "3.9" and python_version < "3.13"
sympy==1.13.1 ; python_version >= "3.9" and python_version < "3.13"
threadpoolctl==3.6.0 ; python_version >= "3.9" and python_version < "3.13"
Hotfixing gaudi deps. (#3174)
2025-04-15 09:55:28 +00:00
tokenizers==0.21.1 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
torch==2.6.0 ; python_version >= "3.9" and python_version < "3.13"
tqdm==4.67.1 ; python_version >= "3.9" and python_version < "3.13"
Hotfixing gaudi deps. (#3174)
2025-04-15 09:55:28 +00:00
transformers==4.49.0 ; python_version >= "3.9" and python_version < "3.13"
Upgrading the dependencies in Gaudi backend. (#3170) * Upgrading the dependencies in Gaudi backend. * Upgrading transformers version.
2025-04-15 09:49:06 +00:00
triton==3.2.0 ; python_version >= "3.9" and python_version < "3.13" and platform_system == "Linux" and platform_machine == "x86_64"
typer==0.15.2 ; python_version >= "3.9" and python_version < "3.13"
typing-extensions==4.13.2 ; python_version >= "3.9" and python_version < "3.13"
typing-inspection==0.4.0 ; python_version >= "3.9" and python_version < "3.13"
urllib3==2.4.0 ; python_version >= "3.9" and python_version < "3.13"
win32-setctime==1.2.0 ; python_version >= "3.9" and python_version < "3.13" and sys_platform == "win32"
wrapt==1.17.2 ; python_version >= "3.9" and python_version < "3.13"
zipp==3.21.0 ; python_version >= "3.9" and python_version < "3.13"
Reference in New Issue Copy Permalink