huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
e9ba044250
text-generation-inference/docs/source/conceptual
History
Vaibhav Srivastav b1bc0ecb7f Update Quantization docs and minor doc fix. (#2368) 
* Update Quantization docs and minor doc fix.

* update readme with latest quants info

* Apply suggestions from code review

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

* up

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
2024-09-25 06:01:59 +00:00
..
flash_attention.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
guidance.md Add support for exl2 quantization 2024-09-24 03:19:39 +00:00
lora.md feat: include local lora adapter loading docs (#2359) 2024-09-25 05:55:39 +00:00
paged_attention.md Paged Attention Conceptual Guide (#901) 2023-09-08 14:18:42 +02:00
quantization.md Update Quantization docs and minor doc fix. (#2368) 2024-09-25 06:01:59 +00:00
safetensors.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
speculation.md feat: add train medusa head tutorial (#1934) 2024-07-17 05:36:58 +00:00
streaming.md fix typos in docs and add small clarifications (#1790) 2024-06-10 09:24:52 +03:00
tensor_parallelism.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00