huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-12 04:44:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix typo

Browse Source
This commit is contained in:
Stefan Daniel Schwarz 2024-06-13 00:46:35 +02:00
parent 86b42f5f6d
commit 98adc45401
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
.env
View File

@ -49,7 +49,7 @@ MAX_BATCH_PREFILL_TOKENS=32818
#MAX_BATCH_PREFILL_TOKENS=8242
################################################################################
# Mixtral 8X7B Instruct v0.1 - AWQ
# Mixtral 8x7B Instruct v0.1 - AWQ
################################################################################
#MODEL_ID=casperhansen/mixtral-instruct-awq
#MAX_INPUT_TOKENS=32767