mirrors/ruff
1
0
Fork 0
mirror of https://github.com/astral-sh/ruff.git synced 2025-09-29 13:24:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

Handle t-string prefixes in SimpleTokenizer (#20578)

Browse source 
The simple tokenizer is meant to skip strings, but it was recording a
`Name` token for t-strings (from the `t`). This PR fixes that.
This commit is contained in:
Dylan 2025-09-25 14:33:37 -05:00 • committed by GitHub
parent cfc64d1707
commit f2b7c82534
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
4 changed files with 54 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

10
crates/ruff_python_trivia/src/tokenizer.rs
View file

@ -599,6 +599,16 @@ impl<'a> SimpleTokenizer<'a> {
| "rb"
| "rf"
| "u"
| "T"
| "TR"
| "Tr"
| "RT"
| "Rt"
| "t"
| "tR"
| "tr"
| "rT"
| "rt"
)
{
self.bogus = true;