mirrors/RustPython-Parser
1
0
Fork 0
mirror of https://github.com/RustPython/Parser.git synced 2025-07-18 18:45:23 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
450 commits 5 branches 3 tags 4.3 MiB
Commit graph

19 commits

Author SHA1 Message Date
harupy
f260785da4 Remove useless String::from 
Signed-off-by: harupy <hkawamura0130@gmail.com>
 2023-01-16 21:27:57 +09:00
Ran Benita
bb2abd1cbc Fixup parse_tokens after "Add NonLogicalNewline token" 
I only updated `parse()` to ignore `NonLogicalNewline`, didn't notice
it's also needed in `parse_tokens()`.
 2023-01-14 11:52:33 +02:00
Ran Benita
5cc208cc43 Add NonLogicalNewline token 
This token is completely ignored by the parser, but it's useful for
other users of the lexer, such as the Ruff linter. For example, the
token is helpful for a "trailing comma" lint.

The same idea exists in Python's `tokenize` module - there is a NEWLINE
token (logical newline), and a NL token (non-logical newline).

Fixes #4385.
 2023-01-12 16:47:12 +02:00
harupy
1a28e49adc Include comment text in token 2023-01-06 23:29:20 +09:00
Dimitris Fasarakis Hilliard
bf715ab1ca Move tests for with into parser. 2023-01-01 21:36:07 +02:00
harupy
faec9372f9 Fix FormattedValue location 2022-12-30 21:39:29 +09:00
harupy
a5553aea43 Fix slice location 2022-12-25 09:37:07 +09:00
harupy
2d75aeb276 Fix end location of nodes containing body 2022-12-11 12:35:28 +09:00
harupy
8e0bef913c add tests 2022-12-04 05:59:51 +09:00
Charlie Marsh
c3f246693b Implement Tok::Comment 2022-11-07 10:33:55 -05:00
dvermd
1dfa2e5239 improve col_offset in new line and lalr 2022-10-26 21:30:51 +02:00
dvermd
ac77f7f501 Fix ast types' _fields and use 0-based column 2022-10-27 03:09:38 +09:00
Charlie Marsh
efad01d976 Remove parse_program_tokens 2022-10-17 12:04:30 -04:00
Charlie Marsh
452d28719f Expose a method to parse AST from tokens directly 2022-10-17 09:39:48 -04:00
Charlie Marsh
8a32bab00a Add end locations to all nodes (#4192) 2022-10-17 13:18:30 +09:00
Jeong YunWon
a1640e4aa1 new_syntax_error working without full compiler 
Fix #4100
 2022-08-23 05:08:24 +09:00
Jeong YunWon
9d6ab72d79 integrate ast::Location into compilre-core::Location 2022-08-22 08:42:20 +09:00
Jeong YunWon
03ccd4b9d8 Add source_path to ParseError 2022-08-22 08:42:20 +09:00
Jeong YunWon
060d153bb3 reorganize compiler crates 2022-08-22 04:42:42 +09:00