huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-20 06:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,356 Commits 227 Branches 59 Tags 47 MiB
chunked_attn_l4
Commit Graph

3 Commits

Author SHA1 Message Date
drbh
82f6ea1b71
feat: improve star coder to support multi lora layers (#2883) 
* feat: improve star coder to support multi lora layers

* feat: improve weight that support adapters and add tests for starcoder with lora

* fix: bump snapshot for added tests

* fix: rerun pre commit lints

* fix: bump adapter test for added later names
 2025-01-16 16:23:55 -05:00
drbh
6cb42f49ae
feat: support lora revisions and qkv_proj weights (#2482) 
* feat: support lora revisions and qkv_proj weights

* fix: add qkv_proj weights to weight test
 2024-09-02 13:09:06 -04:00
drbh
5d85a958c9
fix: refactor adapter weight loading and mapping (#2193) 
* fix: refactor adapter weight loading and mapping

* feat: enable lora load from directory

* fix: adjust launcher for local lora adapters

* feat: improve weight loading and add tests

* fix: improve logging and rebase syntax issue

* fix: impove adapter merge comments and remove unused conditional

* fix: improve get_model_with_lora_adapters naming

* fix: comment typo
 2024-07-24 15:32:14 -04:00