text-generation-inference/docs/source
Mohit Sharma d9bb9bebc9
Add llama4 (#3145)
* initial changes

* Add support for other vlm

* cleanup comment

* Improve attn_implementation

* Add comments for support of models

* add model

* add model

* fixes and improvements

* update docker

* Add cache position

* Add tests

* remove redundant changes

* remove tr version

* Upgrade doc + fix linting.

* Fixing the CI.

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2025-04-06 10:20:22 +02:00
..
backends Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
basic_tutorials Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
conceptual Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
reference configurable termination timeout (#3126) 2025-03-20 14:25:56 +01:00
_toctree.yml Release of Gaudi Backend for TGI (#3091) 2025-03-13 10:56:01 +01:00
architecture.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
index.md Removing ../ that broke the link (#2789) 2024-12-02 05:48:55 +01:00
installation_amd.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_gaudi.md Release of Gaudi Backend for TGI (#3091) 2025-03-13 10:56:01 +01:00
installation_inferentia.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
installation_intel.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_nvidia.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
installation_tpu.md Fix typo in TPU docs (#2911) 2025-01-15 18:32:07 +01:00
installation.md MI300 compatibility (#1764) 2024-05-17 15:30:47 +02:00
multi_backend_support.md Avoid running neuron integration tests twice (#3054) 2025-02-26 12:15:01 +01:00
quicktour.md Prepare for patch release. (#3124) 2025-03-18 15:11:55 +01:00
supported_models.md Add llama4 (#3145) 2025-04-06 10:20:22 +02:00
usage_statistics.md fix: Telemetry (#2957) 2025-01-28 10:29:18 +01:00