Commit Graph

73 Commits

Author SHA1 Message Date
JustSong
44729da277 fix: provide a default value for api-version if not given (#57) 2023-05-13 11:41:57 +08:00
JustSong
7a3378b4b7 feat: Azure API supported without verification (#48, #57) 2023-05-13 11:36:36 +08:00
JustSong
d9db16e999 feat: able to configure ratio for more models now (close #53) 2023-05-11 20:59:35 +08:00
JustSong
331177d97e fix: return quota to user when delete token (close #37) 2023-05-04 10:20:39 +08:00
JustSong
7c66fc6c21 fix: shouldn't close c.Request.Body too soon (close #35) 2023-04-29 14:49:10 +08:00
JustSong
d93cb8f645 feat: able to configure ratio for different models (close #26) 2023-04-28 19:16:37 +08:00
JustSong
b08cd7e104 refactor: use tiktoken-go to calculate token number 2023-04-28 18:36:17 +08:00
JustSong
aea6c859e7 fix: relay bug fix 2023-04-28 18:16:59 +08:00
JustSong
480e789cd8 feat: support configuring ratio when estimating token number in stream mode 2023-04-28 17:25:05 +08:00
JustSong
23ec541ba6 refactor: improve relay's implementation 2023-04-28 17:11:57 +08:00
JustSong
053bb85a1c feat: now use token as the unit of quota (close #33) 2023-04-28 16:58:55 +08:00
JustSong
601fa5cea8 refactor: use quota instead of times 2023-04-28 14:57:20 +08:00
JustSong
109736cc05 fix: only reduce remain times when request /v1/chat/completions (close #15)
BREAKING CHANGE: now remain_times is -1 doesn't mean unlimited times anymore!
2023-04-26 10:45:34 +08:00
JustSong
69ee87c57f fix: fully support stream mode now (close #3) 2023-04-25 21:50:57 +08:00
JustSong
b74a17c963 fix: improve the implementation of sse 2023-04-25 20:45:50 +08:00
JustSong
5d602e9b57 fix: fixing SSE support 2023-04-25 20:27:53 +08:00
JustSong
16271e7813 fix: relay more headers 2023-04-25 11:30:34 +08:00
JustSong
0198df5962 fix: only keep header Authorization & Content-Type 2023-04-25 10:47:25 +08:00
JustSong
4c0dc50af0 fix: fix http2: invalid Connection request header: ["upgrade"] 2023-04-25 10:19:00 +08:00
JustSong
b3be4d8f85 Support custom channel now 2023-04-23 20:35:49 +08:00
JustSong
b86e1dec64 Fix "HTTP decompression failed" 2023-04-23 19:19:43 +08:00
JustSong
279ae8ad50 Bug fix 2023-04-23 18:32:59 +08:00
JustSong
852af57c03 Relay done but not working 2023-04-23 18:24:11 +08:00