text-generation-inference/docs/source/conceptual
drbh a758d32c64 feat: add train medusa head tutorial (#1934)
This PR adds a tutorial to self distill and train medusa heads for a
specific model

---------

Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2024-07-17 05:36:58 +00:00
..
flash_attention.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
guidance.md Correct 'using guidance' link (#1892) 2024-07-17 05:36:58 +00:00
paged_attention.md Paged Attention Conceptual Guide (#901) 2023-09-08 14:18:42 +02:00
quantization.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
safetensors.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00
speculation.md feat: add train medusa head tutorial (#1934) 2024-07-17 05:36:58 +00:00
streaming.md fix typos in docs and add small clarifications (#1790) 2024-06-10 09:24:52 +03:00
tensor_parallelism.md chore: add pre-commit (#1569) 2024-04-24 15:32:02 +03:00