mirror of
https://github.com/astral-sh/ruff.git
synced 2025-08-22 11:25:26 +00:00
86ccdcc9d9
## Summary Allows for proper lexing of tokens like `->`. The main challenge is to ensure that our forward and backwards representations are the same for cases like `===`. Specifically, we want that to lex as `==` followed by `=` regardless of whether it's a forwards or backwards lex. To do so, we identify the range of the sequential characters (the full span of `===`), lex it forwards, then return the last token. ## Test Plan `cargo test` |
||
|---|---|---|
| .. | ||
| snapshots | ||
| cursor.rs | ||
| lib.rs | ||
| textwrap.rs | ||
| tokenizer.rs | ||
| whitespace.rs | ||