huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-24 00:12:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
65db02f192
text-generation-inference/router/client/src
History
OlivierDehaene d077150eb7
fix: fix gpt-q with groupsize = -1 (#1358)
2023-12-18 16:07:05 +01:00
..
pb Init 2022-10-08 12:30:12 +02:00
client.rs fix: fix gpt-q with groupsize = -1 (#1358) 2023-12-18 16:07:05 +01:00
lib.rs Speculative (#1308) 2023-12-11 12:46:30 +01:00
sharded_client.rs feat: add more latency metrics in forward (#1346) 2023-12-14 15:59:38 +01:00