mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-05-02 23:42:06 +00:00
8e0c161d0a
* Incomplete generation stream fix (#2754) entries.len() could > batch.size in prefill, so need to filter as well. Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> * entries was wrongly extended for model that did not support chunking --------- Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Co-authored-by: Wang, Yi <yi.a.wang@intel.com> |
||
|---|---|---|
| .. | ||
| client | ||
| backend.rs | ||
| block_allocator.rs | ||
| lib.rs | ||
| main.rs | ||
| queue.rs | ||
| radix.rs | ||