diff --git a/docs/source/conceptual/tensor_parallelism.md b/docs/source/conceptual/tensor_parallelism.md index c29eb6aa..5075f3f7 100644 --- a/docs/source/conceptual/tensor_parallelism.md +++ b/docs/source/conceptual/tensor_parallelism.md @@ -8,6 +8,6 @@ In TGI, tensor parallelism is implemented under the hood by sharding weights and -Tensor Parallelism only works for model with custom kernels. +Tensor Parallelism only works for model officially supported, it will not work when falling back on `transformers`.