huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 14:52:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
revert
text-generation-inference/server/text_generation_server/models/custom_modeling
History
Dean Wyatte 13c62be467
GPTNeoX: Use static rotary embedding (#1498) 
# What does this PR do?

`transformers` 4.35 removed rotary embeddings from GPTNeoX's weights
([link to line
diff](253f9a3f97 (diff-0e2a05d86c82e96f516db8c14070ceb36f53ca44c6bc21a9cd92ad2e777b9cf1R298))).
This applies the same fix as
https://github.com/huggingface/text-generation-inference/pull/793 which
generates them on-the-fly using the appropriate value from the config
file

Fixes
https://github.com/huggingface/text-generation-inference/issues/1460

## Before submitting
- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [ ] Did you read the [contributor
guideline](https://github.com/huggingface/transformers/blob/main/CONTRIBUTING.md#start-contributing-pull-requests),
      Pull Request section?
- [x] Was this discussed/approved via a Github issue or the
[forum](https://discuss.huggingface.co/)? Please add a link
      to it if that's the case.
- [ ] Did you make sure to update the documentation with your changes?
Here are the
[documentation
guidelines](https://github.com/huggingface/transformers/tree/main/docs),
and
[here are tips on formatting
docstrings](https://github.com/huggingface/transformers/tree/main/docs#writing-source-documentation).
- [ ] Did you write any new necessary tests?


## Who can review?

@OlivierDehaene OR @Narsil
2024-02-01 09:34:11 +01:00
..
__init__.py feat(server): flash santacoder (#153) 2023-04-03 19:06:42 +02:00
bloom_modeling.py feat: format code (#1070) 2023-09-27 12:22:09 +02:00
flash_llama_modeling.py chore: formatting 2023-12-11 14:49:52 +01:00
flash_mistral_modeling.py fix: fix logic if sliding window key is not present in config (#1352) 2023-12-15 14:56:17 +01:00
flash_mixtral_modeling.py fix: fix logic if sliding window key is not present in config (#1352) 2023-12-15 14:56:17 +01:00
flash_neox_modeling.py GPTNeoX: Use static rotary embedding (#1498) 2024-02-01 09:34:11 +01:00
flash_phi_modeling.py v1.4.0 (#1494) 2024-01-26 19:04:57 +01:00
flash_rw_modeling.py Add RoCm support (#1243) 2023-11-27 14:08:12 +01:00
flash_santacoder_modeling.py feat: update exllamav2 kernels (#1370) 2023-12-21 17:25:22 +01:00
idefics_config.py small fix on idefics (#954) 2023-09-01 18:44:34 +02:00
idefics_image_processing.py chore: formatting 2023-12-11 14:49:52 +01:00
idefics_modeling.py chore: formatting 2023-12-11 14:49:52 +01:00
idefics_perceiver.py feat: format code (#1070) 2023-09-27 12:22:09 +02:00
idefics_processing.py chore: formatting 2023-12-11 14:49:52 +01:00
idefics_vision.py feat: format code (#1070) 2023-09-27 12:22:09 +02:00
mpt_modeling.py v1.4.0 (#1494) 2024-01-26 19:04:57 +01:00
neox_modeling.py Fix: Replace view() with reshape() in neox_modeling.py to resolve RuntimeError (#1155) 2023-10-19 11:54:26 +02:00
opt_modeling.py Complete FastLinear.load parameters in OPTDecoder initialization (#1060) 2023-09-27 12:25:59 +02:00
phi_modeling.py v1.4.0 (#1494) 2024-01-26 19:04:57 +01:00
t5_modeling.py Fixing t5 loading. (#1042) 2023-09-25 12:22:28 +02:00