huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 20:04:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
chris-aeviator 2023-08-27 14:43:26 +02:00 committed by GitHub
parent 4d8e47e0e9
commit db8937c209
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -9,6 +9,7 @@ TGI is well suited for distributed/ cloud burst/ on-demand workloads, yet HF's f
## Goals
- Support Model loading from wherever you want (HDFS, S3, HTTPS, …)
- Support Adapters (LORA/PEFT) without merging (possibly huge) Checkpoints and uploading them to 🤗
- Support last Gen GPUS (back to Pascal hopefully)
- Reduce operational cost by making TGI-😑 an disposable, hot swapable workhorse
- Get back to a truyl open source license
- Support more core frameworks than HF products