mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-09-10 11:54:52 +00:00
Update README
This commit is contained in:
parent
37194a5b9a
commit
a0e5fc4189
25
README.md
25
README.md
@ -21,21 +21,23 @@ to power LLMs api-inference widgets.
|
|||||||
|
|
||||||
## Table of contents
|
## Table of contents
|
||||||
|
|
||||||
- [Features](#features)
|
- [Text Generation Inference](#text-generation-inference)
|
||||||
- [Optimized Architectures](#optimized-architectures)
|
- [Table of contents](#table-of-contents)
|
||||||
- [Get Started](#get-started)
|
- [Features](#features)
|
||||||
|
- [Optimized architectures](#optimized-architectures)
|
||||||
|
- [Get started](#get-started)
|
||||||
- [Docker](#docker)
|
- [Docker](#docker)
|
||||||
- [API Documentation](#api-documentation)
|
- [API documentation](#api-documentation)
|
||||||
- [A note on Shared Memory](#a-note-on-shared-memory-shm)
|
|
||||||
- [Distributed Tracing](#distributed-tracing)
|
- [Distributed Tracing](#distributed-tracing)
|
||||||
- [Local Install](#local-install)
|
- [A note on Shared Memory (shm)](#a-note-on-shared-memory-shm)
|
||||||
|
- [Local install](#local-install)
|
||||||
- [CUDA Kernels](#cuda-kernels)
|
- [CUDA Kernels](#cuda-kernels)
|
||||||
- [Run BLOOM](#run-bloom)
|
- [Run BLOOM](#run-bloom)
|
||||||
- [Download](#download)
|
- [Download](#download)
|
||||||
- [Run](#run)
|
- [Run](#run)
|
||||||
- [Quantization](#quantization)
|
- [Quantization](#quantization)
|
||||||
- [Develop](#develop)
|
- [Develop](#develop)
|
||||||
- [Testing](#testing)
|
- [Testing](#testing)
|
||||||
|
|
||||||
## Features
|
## Features
|
||||||
|
|
||||||
@ -241,6 +243,11 @@ make router-dev
|
|||||||
## Testing
|
## Testing
|
||||||
|
|
||||||
```shell
|
```shell
|
||||||
|
# python
|
||||||
|
make python-server-tests
|
||||||
|
make python-client-tests
|
||||||
|
# or both server and client tests
|
||||||
make python-tests
|
make python-tests
|
||||||
|
# rust cargo tests
|
||||||
make integration-tests
|
make integration-tests
|
||||||
```
|
```
|
||||||
|
Loading…
Reference in New Issue
Block a user