mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-13 17:05:24 +00:00
99b662f8c2
* Improve the Consuming TGI docs. * Fix erronous update to . * add info about Open AI client. * More updates. * Apply suggestions from code review Co-authored-by: Erik Kaunismäki <erik.kaum@gmail.com> * Suggestions from Lucain. * Update Gradio snippet. * Up. * Apply suggestions from code review Co-authored-by: Lucain <lucainp@gmail.com> * Update docs/source/basic_tutorials/consuming_tgi.md Co-authored-by: Lucain <lucainp@gmail.com> * Up. * Apply suggestions from code review Co-authored-by: Omar Sanseviero <osanseviero@gmail.com> * Up. * Up. * Doc review from Nico. * Doc review from Nico. x2 * Last nit --------- Co-authored-by: Erik Kaunismäki <erik.kaum@gmail.com> Co-authored-by: Lucain <lucainp@gmail.com> Co-authored-by: Omar Sanseviero <osanseviero@gmail.com> |
||
|---|---|---|
| .. | ||
| flash_attention.md | ||
| guidance.md | ||
| lora.md | ||
| paged_attention.md | ||
| quantization.md | ||
| safetensors.md | ||
| speculation.md | ||
| streaming.md | ||
| tensor_parallelism.md | ||