mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-09-10 20:04:52 +00:00
Move launch locally to an installation section
This commit is contained in:
parent
33e6d264ab
commit
9304e07423
@ -3,12 +3,12 @@
|
||||
title: Text Generation Inference
|
||||
- local: quicktour
|
||||
title: Quick Tour
|
||||
- local: installation
|
||||
title: Installation
|
||||
- local: supported_models
|
||||
title: Supported Models and Hardware
|
||||
title: Getting started
|
||||
- sections:
|
||||
- local: basic_tutorials/local_launch
|
||||
title: Installing from the Source and Launching TGI
|
||||
- local: basic_tutorials/consuming_tgi
|
||||
title: Consuming TGI
|
||||
- local: basic_tutorials/preparing_model
|
||||
|
@ -1,9 +1,16 @@
|
||||
# Installing from the Source and Launching TGI
|
||||
# Installation
|
||||
|
||||
This section explains how to install the CLI tool as well as installing TGI from source. **The strongly recommended approach is to use Docker, as it does not require much setup. Check [the Quick Tour](./quicktour) to learn how to run TGI with Docker.**
|
||||
|
||||
## Install CLI
|
||||
|
||||
TODO
|
||||
|
||||
Before you start, you will need to setup your environment, and install Text Generation Inference. Text Generation Inference is tested on **Python 3.9+**.
|
||||
|
||||
## Local Installation from Source
|
||||
|
||||
Before you start, you will need to setup your environment, and install Text Generation Inference. Text Generation Inference is tested on **Python 3.9+**.
|
||||
|
||||
Text Generation Inference is available on pypi, conda and GitHub.
|
||||
|
||||
To install and launch locally, first [install Rust](https://rustup.rs/) and create a Python virtual environment with at least
|
Loading…
Reference in New Issue
Block a user