text-generation-inference/backends/v3/src
Nicolas Patry 38fcafcf96
Adding a test for FD. (#2516)
* Adding a test for FD.

* Fixing flashdecoding (empty batch doesn't work).

* Fixing the invalid popping.

* Fixing radix with block_size > 1

* Last reference.

* Use an actual hash.

* Update hash for slice.len() == 1

* Update the locks.

* Increasing docker timeout.
2024-09-16 17:00:54 +02:00
..
client Lots of improvements (Still 2 allocators) (#2449) 2024-08-29 16:29:01 +02:00
backend.rs Prefix test - Different kind of load test to trigger prefix test bugs. (#2490) 2024-09-11 18:10:40 +02:00
block_allocator.rs Lots of improvements (Still 2 allocators) (#2449) 2024-08-29 16:29:01 +02:00
lib.rs Keeping the benchmark somewhere (#2401) 2024-08-12 15:22:02 +02:00
main.rs Pr 2352 ci branch (#2382) 2024-08-09 10:54:32 +02:00
queue.rs Adding a test for FD. (#2516) 2024-09-16 17:00:54 +02:00
radix.rs Adding a test for FD. (#2516) 2024-09-16 17:00:54 +02:00