Update README

This commit is contained in:
ehsanmok 2023-04-26 18:10:13 -07:00
parent 37194a5b9a
commit a0e5fc4189

View File

@ -21,21 +21,23 @@ to power LLMs api-inference widgets.
## Table of contents
- [Features](#features)
- [Optimized Architectures](#optimized-architectures)
- [Get Started](#get-started)
- [Text Generation Inference](#text-generation-inference)
- [Table of contents](#table-of-contents)
- [Features](#features)
- [Optimized architectures](#optimized-architectures)
- [Get started](#get-started)
- [Docker](#docker)
- [API Documentation](#api-documentation)
- [A note on Shared Memory](#a-note-on-shared-memory-shm)
- [API documentation](#api-documentation)
- [Distributed Tracing](#distributed-tracing)
- [Local Install](#local-install)
- [A note on Shared Memory (shm)](#a-note-on-shared-memory-shm)
- [Local install](#local-install)
- [CUDA Kernels](#cuda-kernels)
- [Run BLOOM](#run-bloom)
- [Run BLOOM](#run-bloom)
- [Download](#download)
- [Run](#run)
- [Quantization](#quantization)
- [Develop](#develop)
- [Testing](#testing)
- [Develop](#develop)
- [Testing](#testing)
## Features
@ -241,6 +243,11 @@ make router-dev
## Testing
```shell
# python
make python-server-tests
make python-client-tests
# or both server and client tests
make python-tests
# rust cargo tests
make integration-tests
```