mirrors/ruff
1
0
Fork 0
mirror of https://github.com/astral-sh/ruff.git synced 2025-11-11 08:32:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3
ruff/crates/ruff_python_trivia_integration_tests
History
Dhruv Manilawala 025768d303
Add Tokens newtype wrapper, TokenKind iterator (#11361) 
## Summary

Alternative to #11237 

This PR adds a new `Tokens` struct which is a newtype wrapper around a
vector of lexer output. This allows us to add a `kinds` method which
returns an iterator over the corresponding `TokenKind`. This iterator is
implemented as a separate `TokenKindIter` struct to allow using the type
and provide additional methods like `peek` directly on the iterator.

This exposes the linter to access the stream of `TokenKind` instead of
`Tok`.

Edit: I've made the necessary downstream changes and plan to merge the
entire stack at once.
2024-05-14 16:45:04 +00:00
..
src
tests Add Tokens newtype wrapper, TokenKind iterator (#11361) 2024-05-14 16:45:04 +00:00
Cargo.toml Move sub-crates to workspace dependencies (#11407) 2024-05-13 14:37:50 +00:00
README.md

README.md

Integration tests for ruff_python_trivia

This crate includes integration tests for the ruff_python_trivia crate.

The reason for having a separate crate is to avoid introducing a dev circular dependency between the ruff_python_parser crate and the ruff_python_trivia crate.

This crate shouldn't include any code, only tests.

Reference: