mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-21 04:45:23 +00:00
dc5f05f8e6
* change ChatCompletionChunk to align with "OpenAI Chat Completions streaming API" Moving after tool_calls2 Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> add in Buffering.. Signed-off-by: Wang, Yi A <yi.a.wang@intel.com> fix: handle usage outside of stream state and add tests Simplifying everything quite a bit. Remove the unused model_dump. Clippy. Clippy ? Ruff. Uppgrade the flake for latest transformers. Upgrade after rebase. Remove potential footgun. Fix completion test. * Clippy. * Tweak for multi prompt. * Ruff. * Update the snapshot a bit. --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> |
||
|---|---|---|
| .. | ||
| infer | ||
| config.rs | ||
| kserve.rs | ||
| lib.rs | ||
| logging.rs | ||
| sagemaker.rs | ||
| server.rs | ||
| usage_stats.rs | ||
| validation.rs | ||
| vertex.rs | ||