8 Commits

Author	SHA1	Message	Date
OlivierDehaene	745f596c88	feat(server): use float16 (#304)	2023-05-10 15:51:10 +02:00
OlivierDehaene	68e9d6ab33	feat(server): shard token decode (#303)	2023-05-10 15:48:21 +02:00
OlivierDehaene	85aa7e2e7b	feat(server): support hf endpoint weight layout (#266)	2023-05-03 11:36:24 +02:00
OlivierDehaene	343437c7b5	feat(router): add device and dtype info (#215)	2023-04-21 15:36:29 +02:00
OlivierDehaene	880a76eed5	feat(server): support sharded santacoder (#167)	2023-04-12 17:18:08 +02:00
OlivierDehaene	f26dfd0dc1	feat(server): support OPT models (#55) ... OPT models do not all have a `tokenizer.json` file on the hub at the moment. Can't merge for now.	2023-04-11 19:16:41 +02:00
OlivierDehaene	9987960062	feat(router): make router input validation optional (#164)	2023-04-09 20:22:27 +02:00
OlivierDehaene	3fef90d50f	feat(clients): Python client (#103)	2023-03-07 18:52:22 +01:00