text-generation-inference/docs/source/installation_inferentia.md

Using TGI with Inferentia

You can use TGI on AWS Trainium and Inferentia platforms using the TGI neuron backend.