huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 08:22:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
620ed7d8aa
text-generation-inference/router/client/src
History
OlivierDehaene e74bd41e0f
feat(server): add paged attention to flash models (#516) 
Closes #478
2023-06-30 19:09:59 +02:00
..
pb Init 2022-10-08 12:30:12 +02:00
client.rs feat(server): add paged attention to flash models (#516) 2023-06-30 19:09:59 +02:00
lib.rs feat: decrease IPC proto size (#367) 2023-05-24 19:19:57 +02:00
sharded_client.rs feat(server): add paged attention to flash models (#516) 2023-06-30 19:09:59 +02:00