Update README

This commit is contained in:
ehsanmok 2023-04-26 18:10:13 -07:00
parent 37194a5b9a
commit a0e5fc4189

View File

@ -21,21 +21,23 @@ to power LLMs api-inference widgets.
## Table of contents ## Table of contents
- [Features](#features) - [Text Generation Inference](#text-generation-inference)
- [Optimized Architectures](#optimized-architectures) - [Table of contents](#table-of-contents)
- [Get Started](#get-started) - [Features](#features)
- [Docker](#docker) - [Optimized architectures](#optimized-architectures)
- [API Documentation](#api-documentation) - [Get started](#get-started)
- [A note on Shared Memory](#a-note-on-shared-memory-shm) - [Docker](#docker)
- [Distributed Tracing](#distributed-tracing) - [API documentation](#api-documentation)
- [Local Install](#local-install) - [Distributed Tracing](#distributed-tracing)
- [CUDA Kernels](#cuda-kernels) - [A note on Shared Memory (shm)](#a-note-on-shared-memory-shm)
- [Run BLOOM](#run-bloom) - [Local install](#local-install)
- [Download](#download) - [CUDA Kernels](#cuda-kernels)
- [Run](#run) - [Run BLOOM](#run-bloom)
- [Quantization](#quantization) - [Download](#download)
- [Develop](#develop) - [Run](#run)
- [Testing](#testing) - [Quantization](#quantization)
- [Develop](#develop)
- [Testing](#testing)
## Features ## Features
@ -241,6 +243,11 @@ make router-dev
## Testing ## Testing
```shell ```shell
# python
make python-server-tests
make python-client-tests
# or both server and client tests
make python-tests make python-tests
# rust cargo tests
make integration-tests make integration-tests
``` ```