mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-21 23:12:07 +00:00
* Adding a test for FD. * Fixing flashdecoding (empty batch doesn't work). * Fixing the invalid popping. * Fixing radix with block_size > 1 * Last reference. * Use an actual hash. * Update hash for slice.len() == 1 * Update the locks. * Increasing docker timeout. |
||
---|---|---|
.. | ||
client | ||
backend.rs | ||
block_allocator.rs | ||
lib.rs | ||
main.rs | ||
queue.rs | ||
radix.rs |