language-servers/ruff
1
0
Fork 0
mirror of https://github.com/astral-sh/ruff.git synced 2025-09-30 13:51:37 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
ruff/scripts/benchmarks
History
Micha Reiser 2cd25ef641
Ruff 0.11.0 (#16723) 
## Summary

Follow-up release for Ruff v0.10 that now includes the following two
changes that we intended to ship but slipped:

* Changes to how the Python version is inferred when a `target-version`
is not specified (#16319)
* `blanket-noqa` (`PGH004`): Also detect blanked file-level noqa
comments (and not just line level comments).

## Test plan

I verified that the binary built on this branch respects the
`requires-python` setting
([logs](https://www.diffchecker.com/qyJWYi6W/), left: v0.10, right:
v0.11)
2025-03-14 13:57:56 +01:00
..
dark.svg Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
graph-spec.json Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
light.svg Re-run benchmark and update documentation (#1907) 2023-01-16 01:38:58 -05:00
pyproject.toml Ruff 0.11.0 (#16723) 2025-03-14 13:57:56 +01:00
README.md Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
run.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
run_all.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
run_comparisons.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
run_formatter.sh Update versions in format benchmark script (#8110) 2023-10-21 18:39:31 +00:00
run_plugins.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
run_silent.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
setup.sh Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00
uv.lock Update benchmark scripts, use uv (#15120) 2024-12-23 11:14:15 +01:00

README.md

benchmarks

Utilities for benchmarking Ruff.

Getting Started

Run ./scripts/benchmarks/setup.sh to clone the benchmarking target (CPython).

If you're looking to benchmark Ruff against other tools, you'll also need to run uv venv --project ./scripts/benchmarks, activate the venv and finally uv sync --project ./scripts/benchmarks to create a virtual environment with the required dependencies.

Running Benchmarks

Run ./scripts/benchmarks/run.sh to run Ruff over the target repo (CPython). The ./scripts/benchmarks folder contains a few other benchmarks (e.g., scripts/benchmarks/run_comparisons.sh compares Ruff to a variety of other tools).

Generating Plots

The Vega specification for the benchmark plot depicted in the root README can be found at scripts/benchmarks/graph-spec.json. You can render this JSON spec in the Vega Editor.

The images seen in the README are generated by exporting the rendered Vega spec as SVG (at around 688px wide) and manually bolding the Ruff title and benchmark time. The dark mode variant is generated by changing the fill from fill="#333333" to fill="#C9D1D9".