text-generation-inference/backends
David Corvoysier f01dc9e743
Update neuron backend (#3098)
* feat(neuron): use AWS Neuron SDK 2.21.1

* feat(neuron): bump optimum-neuron version

* feat(neuron): tag latest image for local tests

* test(neuron): simplify sampling test
2025-03-12 09:53:15 +01:00
..
client Revert "feat: improve qwen2-vl startup " (#2924) 2025-01-17 12:09:05 -05:00
gaudi Add Gaudi Backend (#3055) 2025-02-28 12:14:58 +01:00
grpc-metadata Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
llamacpp Update the llamacpp backend (#3022) 2025-03-11 09:19:01 +01:00
neuron Update neuron backend (#3098) 2025-03-12 09:53:15 +01:00
trtllm feat: add support for HF_HUB_USER_AGENT_ORIGIN to add user-agent Origin field in Hub requests. (#3061) 2025-03-04 16:43:50 +01:00
v2 Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
v3 Making tool_calls a vector. (#3075) 2025-03-05 22:32:31 +01:00