huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-09 19:34:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README

Browse Source
This commit is contained in:
ehsanmok 2023-04-26 18:10:13 -07:00
parent 37194a5b9a
commit a0e5fc4189
1 changed files with 28 additions and 21 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
README.md
View File

@ -21,14 +21,16 @@ to power LLMs api-inference widgets.
## Table of contents
- [Text Generation Inference](#text-generation-inference)
- [Table of contents](#table-of-contents)
- [Features](#features)
- [Optimized Architectures](#optimized-architectures)
- [Get Started](#get-started)
- [Optimized architectures](#optimized-architectures)
- [Get started](#get-started)
- [Docker](#docker)
- [API Documentation](#api-documentation)
- [A note on Shared Memory](#a-note-on-shared-memory-shm)
- [API documentation](#api-documentation)
- [Distributed Tracing](#distributed-tracing)
- [Local Install](#local-install)
- [A note on Shared Memory (shm)](#a-note-on-shared-memory-shm)
- [Local install](#local-install)
- [CUDA Kernels](#cuda-kernels)
- [Run BLOOM](#run-bloom)
- [Download](#download)
@ -241,6 +243,11 @@ make router-dev
## Testing
```shell
# python
make python-server-tests
make python-client-tests
# or both server and client tests
make python-tests
# rust cargo tests
make integration-tests
```