huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-23 07:52:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,019 Commits 230 Branches 59 Tags 23 MiB
8d01848370
Commit Graph

9 Commits

Author SHA1 Message Date
Nicolas Patry
8d01848370
Update server tests 
- Default to throughput test in k6
- Use TGI_WIGGLE_ROOM to adjust wiggle room
 2024-08-28 15:42:05 +02:00
Nicolas Patry
1568e82548
OVerride the env in server tests. 2024-08-27 20:06:10 +02:00
OlivierDehaene
1a2d68250a
feat: support typical sampling (#114) 
closes #112
 2023-03-09 11:33:57 +01:00
OlivierDehaene
3fef90d50f
feat(clients): Python client (#103) 2023-03-07 18:52:22 +01:00
OlivierDehaene
313194f6d7
feat(server): support repetition penalty (#47) 2023-02-01 15:58:42 +01:00
OlivierDehaene
15511edc01
feat(server): Support SantaCoder (#26) 2023-01-20 12:24:39 +01:00
OlivierDehaene
32a253063d
feat: Return logprobs (#8) 2022-12-15 17:03:56 +01:00
OlivierDehaene
718096f695
feat: Support stop sequences (#7) 2022-12-12 18:25:22 +01:00
OlivierDehaene
a2985036aa
feat(server): Add model tests (#6) 2022-12-08 18:49:33 +01:00