huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-10 03:44:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update server/text_generation_server/models/custom_modeling/flash_rw_modeling.py

Browse Source 
Co-authored-by: OlivierDehaene <olivier@huggingface.co>
This commit is contained in:
Nicolas Patry 2023-06-07 15:00:20 +02:00 committed by GitHub
parent b8bfb2a91e
commit 5c82dcd2bf
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 0 additions and 5 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
server/text_generation_server/models/custom_modeling/flash_rw_modeling.py
View File

@ -101,11 +101,6 @@ class FlashRWAttention(torch.nn.Module):
def __init__(
self,
config, prefix, weights,
# num_heads,
# num_heads_kv,
# hidden_size,
# bias,
# process_group=None,
reduce=True,
):
super().__init__()