mirrors/RustPython-Parser
1
0
Fork 0
mirror of https://github.com/RustPython/Parser.git synced 2025-07-14 00:25:17 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
484 commits 5 branches 3 tags 4.3 MiB
Commit graph

158 commits

Author SHA1 Message Date
Charlie Marsh
f1f31324d0 Use muiltipeek 2023-02-20 15:03:39 -05:00
Charlie Marsh
8649bf6f8f Add support for match statements to parser 2023-02-20 15:03:39 -05:00
Jeong YunWon
24f4a0ed8f Merge pull request #4490 from DimitrisJim/function_parser 
Add tests, some comments, to function.rs.
 2023-02-13 20:00:35 +09:00
Jeong YunWon
fb4bc89812 Merge pull request #4492 from DimitrisJim/doc_parser_uno 
Document parser crate.
 2023-02-13 17:25:14 +09:00
Dimitris Fasarakis Hilliard
66cbe3fe62 Document parser crate. 2023-02-12 17:58:19 +02:00
Dimitris Fasarakis Hilliard
7714c5f517 Add tests, some comments, to function.rs. 2023-02-11 23:07:57 +02:00
Dimitris Fasarakis Hilliard
e6f361d2a5 Refactor: Join string and string_parser. 2023-02-11 18:05:06 +02:00
Jeong YunWon
4ee4fcf407 Add test_generator_expression_argument 2023-02-11 05:20:39 +09:00
Charlie Marsh
dc78f6033b Use entire range for generators-as-arguments 2023-02-10 10:39:40 -05:00
Dimitris Fasarakis Hilliard
31e0962c66 Document lexer. 2023-02-07 21:43:57 +02:00
Dimitris Fasarakis Hilliard
639e8fc52f Move NewLineHandler inline, don't check each character twice. 2023-02-07 20:58:53 +02:00
Jeong YunWon
00dc7ec709 use workspace dependencies 2023-02-06 15:30:38 +09:00
Dimitris Fasarakis Hilliard
bff9884df1 Hint that the unwrap should always succeed. 2023-02-01 12:17:33 +02:00
Dimitris Fasarakis Hilliard
c8005694c7 Eat for comma. 2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
d4de01c500 Add initial capacities, use u32s for indents/spaces. 2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
2a4d44d667 Don't call is_emoji_presentation for each invocation of consume_normal 2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
f4831432f9 Match on ascii start/continuation characters before calling functions. 2023-01-31 12:26:05 +02:00
Aarni Koskela
bdc0e257b1 Bump phf to 0.11 series 
string_cache is still using phf_shared 0.10.0 though
 2023-01-25 19:58:43 +02:00
Jeong YunWon
1304e4ba2f Merge pull request #4449 from harupy/fix-dict-spread-in-dict 
Fix AST generated from a dict literal containing dict unpacking
 2023-01-22 20:44:26 +09:00
Anders Kaseorg
b93b23b922 Fix end location for elif blocks 
Since we parse an `elif:` block as an `If` node, its location should
include its `orelse` node like it would for an `if:` block.

Signed-off-by: Anders Kaseorg <andersk@mit.edu>
 2023-01-17 22:39:44 -05:00
harupy
f260785da4 Remove useless String::from 
Signed-off-by: harupy <hkawamura0130@gmail.com>
 2023-01-16 21:27:57 +09:00
harupy
4f32bacf9c Rename test 2023-01-15 23:36:07 +09:00
harupy
a7f1904564 Improve test 2023-01-15 16:53:13 +09:00
harupy
2f4fe8b380 Remove commented-out code 2023-01-15 16:10:51 +09:00
harupy
52d2e25601 Fix dict spreading in dict literal 2023-01-15 13:01:59 +09:00
Ran Benita
bb2abd1cbc Fixup parse_tokens after "Add NonLogicalNewline token" 
I only updated `parse()` to ignore `NonLogicalNewline`, didn't notice
it's also needed in `parse_tokens()`.
 2023-01-14 11:52:33 +02:00
Ran Benita
5cc208cc43 Add NonLogicalNewline token 
This token is completely ignored by the parser, but it's useful for
other users of the lexer, such as the Ruff linter. For example, the
token is helpful for a "trailing comma" lint.

The same idea exists in Python's `tokenize` module - there is a NEWLINE
token (logical newline), and a NL token (non-logical newline).

Fixes #4385.
 2023-01-12 16:47:12 +02:00
Martin Fischer
fea57bcb04 Fix docs.rs build for rustpython-parser 
docs.rs failed to build the documentation of the recently released
rustpython-parser 0.2.0 because the build.rs script couldn't write the
parser.rs file because docs.rs builds the documentation in a sandbox
with a read-only filesystem.

This commit fixes this by writing the parser.rs file to the cargo output
directory instead, as recommended by the docs.rs documentation.[1]

Fixes #4436.

[1]: https://docs.rs/about/builds#read-only-directories
 2023-01-11 09:58:10 +01:00
Noa
e3fa5a54ba Bump all crate versions to 0.2.0 2023-01-11 00:14:28 -06:00
Jeong YunWon
2f33de77c4 first cspell dict 2023-01-09 19:57:23 +09:00
harupy
1a28e49adc Include comment text in token 2023-01-06 23:29:20 +09:00
harupy
60cbfd3a94 Implement Default for Location 2023-01-05 22:48:47 +09:00
harupy
eb75c4fa46 Address comments 2023-01-05 18:24:54 +09:00
harupy
5373dcd74d Use try_from 2023-01-05 01:18:30 +09:00
harupy
7a78e12d52 Simplify string check 2023-01-04 23:57:50 +09:00
Jeong YunWon
cecb205f56 Merge pull request #4417 from harupy/add-with-offset-methods 
Add `with_col_offset` and `with_row_offset` to `Location` for conveniece
 2023-01-04 17:07:31 +09:00
Jeong YunWon
a39772ae8f Merge pull request #4413 from harupy/more-generic-window-impl 
Update `CharWindow` in `compiler/parser/src/lexer.rs` to allow slicing
 2023-01-04 17:06:06 +09:00
harupy
72185fecd5 Add with_col_offset and with_row_offset to Location 2023-01-04 13:16:03 +09:00
harupy
0ca8d9ea4b Address comment 2023-01-04 00:03:18 +09:00
harupy
674ab0d55e Remove incorrect EmptyExpression in parse_formatted_value 2023-01-03 23:55:50 +09:00
harupy
0b65609d26 Improve CharWindow 2023-01-03 17:27:35 +09:00
harupy
b6647b0171 Remove repetitive to_string in parse_escaped_char 2023-01-03 14:48:00 +09:00
Jeong YunWon
50f191b2c7 Merge pull request #4409 from harupy/improve-error-conversion-in-string-parser 
Improve error conversion in `string_parsers.rs`
 2023-01-03 14:39:01 +09:00
harupy
d1d22282bc Fix clippy error 2023-01-03 12:51:31 +09:00
harupy
6374c0df13 Improve error conversion in string_parsers.rs 2023-01-03 12:46:10 +09:00
Jeong YunWon
4a75cc029e Merge pull request #4405 from harupy/use-drain 
Use `drain` to simplify `compiler/parser/src/string_parser.rs`
 2023-01-03 12:41:23 +09:00
Jeong YunWon
d027ead451 Merge pull request #4399 from branai/shell-continuing-fix 
Fix IndentationError works differently with cpython in interective shell
 2023-01-03 04:32:03 +09:00
harupy
4c4bc41163 Use drain 2023-01-03 01:23:44 +09:00
Jim Fasarakis-Hilliard
69c012b8c5 Merge pull request #4404 from harupy/merge-match-arms 
Merge match arms in `StringParser.parse_formatted_value`
 2023-01-02 18:18:40 +02:00
Jim Fasarakis-Hilliard
3770faa705 Merge pull request #4402 from harupy/remove-unreachable-if 
Remove unreachable code in `compiler/parser/src/string_parser.rs`
 2023-01-02 17:05:45 +02:00