huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 15:32:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

updated doc

Browse Source
This commit is contained in:
Mohit Sharma 2024-07-02 13:10:26 +00:00
parent 6d6b0bdcc4
commit 0a5b19a3ed
1 changed files with 0 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/basic_tutorials/fp8_kv_cache.md
View File

@ -60,8 +60,6 @@ docker run --gpus all --shm-size 64g -p 8080:80 -v $volume:/data \
--kv-cache-dtype fp8 --kv-cache-dtype fp8
``` ```
We strongly suggest referring to the detailed [installation instructions](https://github.com/Dao-AILab/flash-attention?tab=readme-ov-file#installation-and-features) to learn more about supported hardware and data types!
</hfoption> </hfoption>
<hfoption id="AMD"> <hfoption id="AMD">