ruff/scripts/benchmarks
Dhruv Manilawala 337af836d3
Some checks are pending
CI / Determine changes (push) Waiting to run
CI / cargo fmt (push) Waiting to run
CI / cargo clippy (push) Blocked by required conditions
CI / cargo test (linux) (push) Blocked by required conditions
CI / cargo test (windows) (push) Blocked by required conditions
CI / cargo test (wasm) (push) Blocked by required conditions
CI / cargo build (release) (push) Blocked by required conditions
CI / cargo build (msrv) (push) Blocked by required conditions
CI / cargo fuzz (push) Blocked by required conditions
CI / Fuzz the parser (push) Blocked by required conditions
CI / test scripts (push) Blocked by required conditions
CI / ecosystem (push) Blocked by required conditions
CI / cargo shear (push) Blocked by required conditions
CI / python package (push) Waiting to run
CI / pre-commit (push) Waiting to run
CI / mkdocs (push) Waiting to run
CI / formatter instabilities and black similarity (push) Blocked by required conditions
CI / test ruff-lsp (push) Blocked by required conditions
CI / benchmarks (push) Blocked by required conditions
Bump version to 0.7.1 (#13913)
2024-10-24 20:57:07 +05:30
..
dark.svg Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
graph-spec.json Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
light.svg Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
poetry.lock ENH: Bump ruff dependency versions to support the latest release of v0.4.0 and Python 3.12 (#11025) 2024-04-19 03:37:54 +00:00
pyproject.toml Bump version to 0.7.1 (#13913) 2024-10-24 20:57:07 +05:30
README.md markdownlint: enforce 100 char max length (#4698) 2023-05-28 22:45:56 -04:00
run.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00
run_all.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00
run_comparisons.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00
run_formatter.sh Update versions in format benchmark script (#8110) 2023-10-21 18:39:31 +00:00
run_plugins.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00
run_silent.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00
setup.sh Rename ruff crate to ruff_linter (#7529) 2023-09-20 08:38:27 +02:00

benchmarks

Utilities for benchmarking Ruff.

Getting Started

Run ./scripts/benchmarks/run.sh to clone the benchmarking target (CPython).

If you're looking to benchmark Ruff against other tools, you'll also need to run poetry install to create a virtual environment with the required dependencies.

Running Benchmarks

Run ./scripts/benchmarks/run.sh to run Ruff over the target repo (CPython). The ./scripts/benchmarks folder contains a few other benchmarks (e.g., scripts/benchmarks/run_comparisons.sh compares Ruff to a variety of other tools).

Generating Plots

The Vega specification for the benchmark plot depicted in the root README can be found at scripts/benchmarks/graph-spec.json. You can render this JSON spec in the Vega Editor.

The images seen in the README are generated by exporting the rendered Vega spec as SVG (at around 688px wide) and manually bolding the Ruff title and benchmark time. The dark mode variant is generated by changing the fill from fill="#333333" to fill="#C9D1D9".