mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-09-10 20:04:52 +00:00
Move launch locally to an installation section
This commit is contained in:
parent
33e6d264ab
commit
9304e07423
@ -3,12 +3,12 @@
|
|||||||
title: Text Generation Inference
|
title: Text Generation Inference
|
||||||
- local: quicktour
|
- local: quicktour
|
||||||
title: Quick Tour
|
title: Quick Tour
|
||||||
|
- local: installation
|
||||||
|
title: Installation
|
||||||
- local: supported_models
|
- local: supported_models
|
||||||
title: Supported Models and Hardware
|
title: Supported Models and Hardware
|
||||||
title: Getting started
|
title: Getting started
|
||||||
- sections:
|
- sections:
|
||||||
- local: basic_tutorials/local_launch
|
|
||||||
title: Installing from the Source and Launching TGI
|
|
||||||
- local: basic_tutorials/consuming_tgi
|
- local: basic_tutorials/consuming_tgi
|
||||||
title: Consuming TGI
|
title: Consuming TGI
|
||||||
- local: basic_tutorials/preparing_model
|
- local: basic_tutorials/preparing_model
|
||||||
|
@ -1,9 +1,16 @@
|
|||||||
# Installing from the Source and Launching TGI
|
# Installation
|
||||||
|
|
||||||
|
This section explains how to install the CLI tool as well as installing TGI from source. **The strongly recommended approach is to use Docker, as it does not require much setup. Check [the Quick Tour](./quicktour) to learn how to run TGI with Docker.**
|
||||||
|
|
||||||
|
## Install CLI
|
||||||
|
|
||||||
|
TODO
|
||||||
|
|
||||||
Before you start, you will need to setup your environment, and install Text Generation Inference. Text Generation Inference is tested on **Python 3.9+**.
|
|
||||||
|
|
||||||
## Local Installation from Source
|
## Local Installation from Source
|
||||||
|
|
||||||
|
Before you start, you will need to setup your environment, and install Text Generation Inference. Text Generation Inference is tested on **Python 3.9+**.
|
||||||
|
|
||||||
Text Generation Inference is available on pypi, conda and GitHub.
|
Text Generation Inference is available on pypi, conda and GitHub.
|
||||||
|
|
||||||
To install and launch locally, first [install Rust](https://rustup.rs/) and create a Python virtual environment with at least
|
To install and launch locally, first [install Rust](https://rustup.rs/) and create a Python virtual environment with at least
|
Loading…
Reference in New Issue
Block a user