text-generation-inference/backends/gaudi/server/README.md

# Text Generation Inference Python gRPC Server

A Python gRPC server for Text Generation Inference

## Install

```shell
make install
```

## Run

```shell
make run-dev
```
Add Gaudi Backend (#3055) * wip(gaudi): import server and dockerfile from tgi-gaudi fork * feat(gaudi): new gaudi backend working * fix: fix style * fix prehooks issues * fix(gaudi): refactor server and implement requested changes 2025-02-28 11:14:58 +00:00			`# Text Generation Inference Python gRPC Server`

			`A Python gRPC server for Text Generation Inference`

			`## Install`

			```shell
			`make install`
			```

			`## Run`

			```shell
			`make run-dev`
			```