mirror of
https://github.com/astral-sh/ruff.git
synced 2025-08-19 18:11:08 +00:00
2cbe1733c8
## Summary The tokenizer was split into a forward and a backwards tokenizer. The backwards tokenizer uses the same names as the forwards ones (e.g. `next_token`). The backwards tokenizer gets the comment ranges that we already built to skip comments. --------- Co-authored-by: Micha Reiser <micha@reiser.io>
5 lines
106 B
Rust
5 lines
106 B
Rust
mod comment_ranges;
|
|
mod indexer;
|
|
|
|
pub use comment_ranges::CommentRangesBuilder;
|
|
pub use indexer::Indexer;
|