text-generation-inference/backends/v3/src
Nicolas Patry 8e92942a18
Making tool_calls a vector. (#3075)
* Making `tool_calls` a vector.

* Update doc.

* Fixing the nix overlay with updated version.

* Add openai dependency.

* Updating the old tests.

* Trying to reduce the logs in the case of errors.

* Less spammy logs too.
2025-03-05 22:32:31 +01:00
..
client Revert "feat: improve qwen2-vl startup " (#2924) 2025-01-17 12:09:05 -05:00
backend.rs Add backend name to telemetry (#2962) 2025-01-28 16:53:16 +01:00
block_allocator.rs Upgrading our rustc version. (#2908) 2025-01-15 17:04:03 +01:00
lib.rs Choosing input/total tokens automatically based on available VRAM? (#2673) 2024-10-28 04:59:49 +01:00
main.rs feat: add payload limit (#2726) 2024-11-21 18:20:15 +00:00
queue.rs Making tool_calls a vector. (#3075) 2025-03-05 22:32:31 +01:00
radix.rs Add property-based testing for RadixAllocator (#3068) 2025-03-04 15:09:46 +01:00