text-generation-inference/backends
Baptiste Colle 683ff53fa3
Add Gaudi Backend (#3055)
* wip(gaudi): import server and dockerfile from tgi-gaudi fork

* feat(gaudi): new gaudi backend working

* fix: fix style

* fix prehooks issues

* fix(gaudi): refactor server and implement requested changes
2025-02-28 12:14:58 +01:00
..
client Revert "feat: improve qwen2-vl startup " (#2924) 2025-01-17 12:09:05 -05:00
gaudi Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
llamacpp Improve Transformers support (#2970) 2025-02-18 19:04:34 +01:00
neuron fix: run linters and fix formatting (#3057) 2025-02-25 16:11:34 -05:00
trtllm [Backend] Bump TRTLLM to v.0.17.0 (#2991) 2025-02-06 16:45:03 +01:00
v2 Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
v3 Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00