huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-09-11 12:24:53 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fixing max_position_embeddings for falcon.

Browse Source
This commit is contained in:
Nicolas Patry 2024-12-10 12:15:13 +01:00
parent b91f0c02c6
commit 22dbc449cd
No known key found for this signature in database
GPG Key ID: D2920555C90F704C
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
server/text_generation_server/models/custom_modeling/flash_rw_modeling.py
View File

@ -78,6 +78,7 @@ class RWConfig(PretrainedConfig):
self.alibi = False self.alibi = False
self.rotary = True self.rotary = True
self.rope_theta = rope_theta self.rope_theta = rope_theta
self.max_position_embeddings = 2048
self.vocab_size = vocab_size self.vocab_size = vocab_size
# Backward compatibility with n_embed kwarg # Backward compatibility with n_embed kwarg