10 Commits

Author	SHA1	Message	Date
OlivierDehaene	15511edc01	feat(server): Support SantaCoder (#26)	2023-01-20 12:24:39 +01:00
Nick Hill	e6d3eb5d5d	fix(server): Minor refactorization using new_zeros (#24) ... - Fix some type hints, in particular base tokenizer class - Make use of `tensor.new_zero/empty` methods - Simplify env var string parsing in launcher	2023-01-17 09:10:22 +01:00
OlivierDehaene	611e21cb13	fix(server): Fix stop sequences (#11)	2022-12-16 16:03:39 +01:00
OlivierDehaene	32a253063d	feat: Return logprobs (#8)	2022-12-15 17:03:56 +01:00
OlivierDehaene	718096f695	feat: Support stop sequences (#7)	2022-12-12 18:25:22 +01:00
OlivierDehaene	a2985036aa	feat(server): Add model tests (#6)	2022-12-08 18:49:33 +01:00
OlivierDehaene	daa1d81d5e	feat(server): Support Galactica (#4)	2022-12-01 19:31:54 +01:00
OlivierDehaene	c5665f5c8b	feat(server): Support generic AutoModelForCausalLM	2022-11-04 14:22:47 +01:00
OlivierDehaene	b3b7ea0d74	feat: Use json formatter by default in docker image	2022-11-02 17:29:56 +01:00
OlivierDehaene	3cf6368c77	feat(server): Support all AutoModelForCausalLM on a best effort basis	2022-10-28 19:24:00 +02:00