roc/crates/compiler/fmt/fuzz
Joshua Warner a046428ce6
Add fuzzing for the formatter and fix bugs
This commit adds fuzzing for the (expr) formatter, with the same invariants that we use for fmt tests:
  * We start with text, which we parse
  * We format the AST, which must succeed
  * We parse back the AST and make sure it's identical igoring whitespace+comments
  * We format the new AST and assert it's equal to the first formatted version ("idempotency")

Interestingly, while a lot of bugs this found were in the formatter, it also found some parsing bugs.

It then fixes a bunch of bugs that fell out:
* Some small oversights in RemoveSpaces
* Make sure `_a` doesn't parse as an inferred type (`_`) followed by an identifier (parsing bug!)
* Call `extract_spaces` on a parsed expr before matching on it, lest it be Expr::SpaceBefore - when parsing aliases
* A few cases where the formatter generated invalid/different code
* Numerous formatting bugs that caused the formatting to not be idempotent

The last point there is worth talking further about. There were several cases where the old code was trying to enforce strong
opinions about how to insert newlines in function types and defs. In both of those cases, it looked like the goals of
(1) idempotency, (2) giving the user some say in the output, and (3) these strong opinions - were often in conflict.

For these cases, I erred on the side of following the user's existing choices about where to put newlines.

We can go back and re-add this strong opinionation later - but this seemed the right approach for now.
2022-12-17 09:52:09 -08:00
..
fuzz_targets Add fuzzing for the formatter and fix bugs 2022-12-17 09:52:09 -08:00
.gitignore Add fuzzing for the formatter and fix bugs 2022-12-17 09:52:09 -08:00
Cargo.lock Add fuzzing for the formatter and fix bugs 2022-12-17 09:52:09 -08:00
Cargo.toml Add fuzzing for the formatter and fix bugs 2022-12-17 09:52:09 -08:00
README.md Add fuzzing for the formatter and fix bugs 2022-12-17 09:52:09 -08:00

fuzz

To setup fuzzing you will need to install cargo-fuzz and run with rust nightly:

$ cargo install cargo-fuzz
$ cargo +nightly fuzz run -j<cores> <target> -- -dict=../parse/fuzz/dict.txt

The different targets can be found by running cargo fuzz list.

When a bug is found, it will be reported with commands to run it again and look for a minimized version. If you are going to file a bug, please minimize the input before filing the bug.