Nicolas Patry 67347950b7 feat(server): Implements sharding for non divisible vocab_size. (#583) ... - The code is relatively easy (just disable the checks on Embedding and Head) This cannot be done in the same easy fashion for hidden_dim/head_dim. It's relatively easy on some models (classic MHA) but it would make the other models (MQA) much more complex, and GPTQ quantization another quite hairy piece of code.		2023-07-12 16:43:31 +02:00
..
models	fix(server): Adding logger import to t5_modeling.py (#585)	2023-07-12 10:40:32 +02:00
pb	feat(server): clear cache on error (#143)	2023-03-28 11:29:35 +02:00
utils	feat(server): Implements sharding for non divisible vocab_size. (#583)	2023-07-12 16:43:31 +02:00
__init__.py	feat(clients): Python client (#103)	2023-03-07 18:52:22 +01:00
cache.py	fix(server): decrease memory fragmentation (#557)	2023-07-06 14:28:33 +02:00
cli.py	fix(server): harden the weights choice to save on disk. (#561)	2023-07-07 14:50:12 +02:00
interceptor.py	feat(clients): Python client (#103)	2023-03-07 18:52:22 +01:00
server.py	feat: Add the option to force another dtype than f16. (#513)	2023-06-30 20:30:09 +02:00
tracing.py	feat(clients): Python client (#103)	2023-03-07 18:52:22 +01:00