huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-22 23:42:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

Upgrade doc + fix linting.

Browse Source
This commit is contained in:
Nicolas Patry 2025-04-06 10:10:37 +02:00
parent 53567b0028
commit f2be5f3db4
No known key found for this signature in database
GPG Key ID: 87B37D879D09DEB4
2 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/supported_models.md
View File

@ -9,7 +9,7 @@ Text Generation Inference enables serving optimized models. The following sectio
- [Idefics 3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3) (Multimodal) - [Idefics 3](https://huggingface.co/HuggingFaceM4/Idefics3-8B-Llama3) (Multimodal)
- [Llava Next (1.6)](https://huggingface.co/llava-hf/llava-v1.6-vicuna-13b-hf) (Multimodal) - [Llava Next (1.6)](https://huggingface.co/llava-hf/llava-v1.6-vicuna-13b-hf) (Multimodal)
- [Llama](https://huggingface.co/collections/meta-llama/llama-31-669fc079a0c406a149a5738f) - [Llama](https://huggingface.co/collections/meta-llama/llama-31-669fc079a0c406a149a5738f)
- [Llama4](https://huggingface.co/collections/ll-re/llama-4-67f03a4fd5f976f3d443fcfd) - [Llama4](https://huggingface.co/collections/meta-llama/llama-31-669fc079a0c406a149a5738f)
- [Phi 3](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) - [Phi 3](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct)
- [Granite](https://huggingface.co/ibm-granite/granite-3.0-8b-instruct) - [Granite](https://huggingface.co/ibm-granite/granite-3.0-8b-instruct)
- [Gemma](https://huggingface.co/google/gemma-7b) - [Gemma](https://huggingface.co/google/gemma-7b)

2
router/src/validation.rs
View File

@ -710,7 +710,7 @@ fn image_tokens(
img_string.push_str(IMAGE_START); img_string.push_str(IMAGE_START);
if ratio_h * ratio_w > 1 { if ratio_h * ratio_w > 1 {
for yy in 0..ratio_h { for _yy in 0..ratio_h {
for xx in 0..ratio_w { for xx in 0..ratio_w {
img_string.push_str(&PATCH.repeat(num_patches_per_chunk)); img_string.push_str(&PATCH.repeat(num_patches_per_chunk));
if xx < ratio_w - 1 { if xx < ratio_w - 1 {