mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-10-09 06:55:24 +00:00
184c89fd55
- Refactor code to allow supporting multiple versions of the generate.proto at the same time - Add v3/generate.proto (ISO to generate.proto for now but allow for future changes without impacting v2 backends) - Add Schedule trait to abstract queuing and batching mechanisms that will be different in the future - Add SchedulerV2/V3 impl |
||
|---|---|---|
| .. | ||
| app.rs | ||
| event.rs | ||
| generation.rs | ||
| lib.rs | ||
| main.rs | ||
| table.rs | ||
| utils.rs | ||