OlivierDehaene 8e0c161d0a fix: incomplete generations w/ single tokens generations and models that did not support chunking (#2770) ... * Incomplete generation stream fix (#2754) entries.len() could > batch.size in prefill, so need to filter as well. Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> * entries was wrongly extended for model that did not support chunking --------- Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> Co-authored-by: Wang, Yi <yi.a.wang@intel.com>		2024-11-21 16:37:55 +00:00
..
client	Choosing input/total tokens automatically based on available VRAM? (#2673)	2024-10-28 04:59:49 +01:00
grpc-metadata	Rebase TRT-llm (#2331)	2024-07-31 10:33:10 +02:00
trtllm	Add support for stop words in TRTLLM (#2678)	2024-10-25 10:58:34 +02:00
v2	Fixing "deadlock" when python prompts for trust_remote_code by always (#2664)	2024-10-25 06:39:21 +02:00
v3	fix: incomplete generations w/ single tokens generations and models that did not support chunking (#2770)	2024-11-21 16:37:55 +00:00