8 Commits

Author	SHA1	Message	Date
OlivierDehaene	343437c7b5	feat(router): add device and dtype info (#215)	2023-04-21 15:36:29 +02:00
OlivierDehaene	e14ae3b5e9	feat(server): support quantization for flash models (#200) ... closes #197	2023-04-19 12:51:11 +02:00
OlivierDehaene	880a76eed5	feat(server): support sharded santacoder (#167)	2023-04-12 17:18:08 +02:00
OlivierDehaene	9987960062	feat(router): make router input validation optional (#164)	2023-04-09 20:22:27 +02:00
OlivierDehaene	c0aeb32583	feat(server): flash santacoder (#153)	2023-04-03 19:06:42 +02:00
OlivierDehaene	678b2f3900	feat(server): cleanup flash neox loading (#139)	2023-03-26 16:37:21 +02:00
OlivierDehaene	d6a93fe992	fix(server): fix flash-neox scores warping (#137)	2023-03-24 18:21:41 +01:00
OlivierDehaene	05e9a796cc	feat(server): flash neoX (#133)	2023-03-24 14:02:14 +01:00