mirror of
https://github.com/astral-sh/ruff.git
synced 2025-07-28 23:43:53 +00:00
1685d95ed2
Some checks are pending
CI / Determine changes (push) Waiting to run
CI / cargo fmt (push) Waiting to run
CI / cargo clippy (push) Blocked by required conditions
CI / cargo test (linux) (push) Blocked by required conditions
CI / cargo test (linux, release) (push) Blocked by required conditions
CI / cargo test (windows) (push) Blocked by required conditions
CI / cargo test (wasm) (push) Blocked by required conditions
CI / cargo build (release) (push) Waiting to run
CI / cargo build (msrv) (push) Blocked by required conditions
CI / cargo fuzz build (push) Blocked by required conditions
CI / fuzz parser (push) Blocked by required conditions
CI / test scripts (push) Blocked by required conditions
CI / ecosystem (push) Blocked by required conditions
CI / cargo shear (push) Blocked by required conditions
CI / python package (push) Waiting to run
CI / pre-commit (push) Waiting to run
CI / mkdocs (push) Waiting to run
CI / formatter instabilities and black similarity (push) Blocked by required conditions
CI / test ruff-lsp (push) Blocked by required conditions
CI / benchmarks (push) Blocked by required conditions
## Summary This PR adds a fuzzer harness for red knot that runs the type checker on source code that contains invalid syntax. Additionally, this PR also updates the `init-fuzzer.sh` script to increase the corpus size to: * Include various crates that includes Python source code * Use the 3.13 CPython source code And, remove any non-Python files from the final corpus so that when the fuzzer tries to minify the corpus, it doesn't produce files that only contains documentation content as that's just noise. ## Test Plan Run `./fuzz/init-fuzzer.sh`, say no to the large dataset. Run the fuzzer with `cargo +night fuzz run red_knot_check_invalid_syntax -- -timeout=5`
42 lines
1.4 KiB
Bash
Executable file
42 lines
1.4 KiB
Bash
Executable file
#!/bin/bash
|
|
|
|
# https://stackoverflow.com/a/246128/3549270
|
|
SCRIPT_DIR=$( cd -- "$( dirname -- "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )
|
|
|
|
cd "$SCRIPT_DIR"
|
|
|
|
if ! cargo fuzz --help >&/dev/null; then
|
|
cargo install --git https://github.com/rust-fuzz/cargo-fuzz.git
|
|
fi
|
|
|
|
if [ ! -d corpus/ruff_fix_validity ]; then
|
|
mkdir -p corpus/ruff_fix_validity
|
|
|
|
(
|
|
cd corpus/ruff_fix_validity
|
|
|
|
read -p "Would you like to build a corpus from a python source code dataset? (this will take a long time!) [Y/n] " -n 1 -r
|
|
echo
|
|
if [[ $REPLY =~ ^[Yy]$ ]]; then
|
|
curl -L 'https://zenodo.org/record/3628784/files/python-corpus.tar.gz?download=1' | tar xz
|
|
fi
|
|
|
|
# Build a smaller corpus in addition to the (optional) larger corpus
|
|
curl -L 'https://github.com/python/cpython/archive/refs/tags/v3.13.0.tar.gz' | tar xz
|
|
cp -r "../../../crates/red_knot_workspace/resources/test/corpus" "red_knot_workspace"
|
|
cp -r "../../../crates/ruff_linter/resources/test/fixtures" "ruff_linter"
|
|
cp -r "../../../crates/ruff_python_formatter/resources/test/fixtures" "ruff_python_formatter"
|
|
cp -r "../../../crates/ruff_python_parser/resources" "ruff_python_parser"
|
|
|
|
# Delete all non-Python files
|
|
find . -type f -not -name "*.py" -delete
|
|
)
|
|
|
|
if [[ "$OSTYPE" == "darwin"* ]]; then
|
|
cargo +nightly fuzz cmin ruff_fix_validity -- -timeout=5
|
|
else
|
|
cargo fuzz cmin -s none ruff_fix_validity -- -timeout=5
|
|
fi
|
|
fi
|
|
|
|
echo "Done! You are ready to fuzz."
|