mirror of
https://github.com/huggingface/text-generation-inference.git
synced 2025-04-19 13:52:07 +00:00
289aa48554
* Move JSON grammar -> regex grammar conversion to the router
This change moves the JSON grammar -> regex grammar conversion to the
router by adding a dependency on the `outlines-core` Rust crate. In
contrast to the Python implementation, the conversions are not LRU-cached
since they seem to be fast enough:
simple schema time: [5.8293 µs 5.8307 µs 5.8320 µs]
change: [-13.166% -12.884% -12.641%] (p = 0.00 < 0.05)
Performance has improved.
complex schema time: [14.875 µs 14.881 µs 14.887 µs]
change: [-2.1637% -1.9914% -1.7852%] (p = 0.00 < 0.05)
Performance has improved.
Using the schemas from:
https://github.com/dottxt-ai/outlines-core/blob/main/benchmarks/bench_json_schema.py
25 lines
629 B
YAML
25 lines
629 B
YAML
repos:
|
|
- repo: https://github.com/pre-commit/pre-commit-hooks
|
|
rev: v4.5.0
|
|
hooks:
|
|
- id: check-yaml
|
|
- id: end-of-file-fixer
|
|
exclude: crate-hashes.json
|
|
- id: trailing-whitespace
|
|
exclude: docs/source/reference/launcher.md
|
|
- repo: https://github.com/psf/black
|
|
rev: 24.2.0
|
|
hooks:
|
|
- id: black
|
|
- repo: https://github.com/doublify/pre-commit-rust
|
|
rev: v1.0
|
|
hooks:
|
|
- id: cargo-check
|
|
- id: fmt
|
|
- id: clippy
|
|
- repo: https://github.com/astral-sh/ruff-pre-commit
|
|
rev: v0.3.0
|
|
hooks:
|
|
- id: ruff
|
|
args: [--fix, --exit-non-zero-on-fix]
|