huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
7872b8c55b
text-generation-inference/router/src
History
drbh 7872b8c55b
Add messages api compatibility docs (#1478) 
This PR adds a new page to the docs that describes the Messages API and
how to use it.

Additionally this page will contain cloud provider specific information
for enabling and using this feature. This PR includes a SageMaker
example/information.
2024-01-24 11:41:28 -05:00
..
health.rs Rebased #617 (#868) 2023-08-28 11:43:47 +02:00
infer.rs feat: support raise_exception, bos and eos tokens (#1450) 2024-01-18 12:31:56 +01:00
lib.rs Disable decoder_input_details on OpenAI-compatible chat streaming, pass temp and top-k from API (#1470) 2024-01-23 09:55:05 -05:00
main.rs Add messages api compatibility docs (#1478) 2024-01-24 11:41:28 -05:00
queue.rs Speculative (#1308) 2023-12-11 12:46:30 +01:00
server.rs Add messages api compatibility docs (#1478) 2024-01-24 11:41:28 -05:00
validation.rs feat: supports openai chat completions API (#1427) 2024-01-16 11:07:41 +01:00