Jeong YunWon
bf3f3eca62
Flatten rustpython_parser interface
2023-02-22 20:32:31 +09:00
Jeong YunWon
a8d4de27ed
make_tokenizer -> lex to integrate terms
...
we don't distinguish scanner or tokenizer from lexer
2023-02-22 20:28:15 +09:00
Jeong YunWon
b5829b547a
relocate feature-independent use
2023-02-22 20:28:03 +09:00
Jeong YunWon
019faeac24
Fix ModeParseError message
2023-02-22 20:28:03 +09:00
Jeong YunWon
aed03c5209
Break down rustpython_parser::error module
...
because it doesn't share any common errors but specific error for each sub module
2023-02-22 20:28:01 +09:00
Charlie Marsh
62d88e0b86
Always wrap in SoftKeywordTransformer
2023-02-21 19:18:42 -05:00
Charlie Marsh
82b91fe9aa
Expose SoftKeywordTransformer on public API
2023-02-21 19:00:32 -05:00
Jim Fasarakis-Hilliard
6e9c759cf7
Merge pull request #4519 from charliermarsh/charlie/match
...
Add support for match statements to parser
2023-02-21 19:43:28 +02:00
Jeong YunWon
304f6bc38e
Merge pull request #4531 from charliermarsh/charlie/exception-groups
...
Implement except* syntax
2023-02-21 13:20:18 +09:00
Charlie Marsh
2a86dbd644
Implement except* syntax
2023-02-21 12:19:54 +09:00
Charlie Marsh
fab9adcd48
Update Python.asdl from CPython 3.11.1
2023-02-21 12:19:51 +09:00
Charlie Marsh
4c559a9a51
Allow starred expressions in subscripts
2023-02-20 17:59:35 -05:00
Charlie Marsh
77e827acd5
Update compiler/parser/src/soft_keywords.rs
...
Co-authored-by: Jim Fasarakis-Hilliard <d.f.hilliard@gmail.com>
2023-02-20 15:03:39 -05:00
Jeong YunWon
591036785c
clean up soft-keyword transform
2023-02-20 15:03:39 -05:00
Charlie Marsh
f1f31324d0
Use muiltipeek
2023-02-20 15:03:39 -05:00
Charlie Marsh
8649bf6f8f
Add support for match statements to parser
2023-02-20 15:03:39 -05:00
John Pham
72ddb53d0f
Make common::repr throw error instead of panic ( #4520 )
2023-02-19 22:09:54 +09:00
Jeong YunWon
24f4a0ed8f
Merge pull request #4490 from DimitrisJim/function_parser
...
Add tests, some comments, to function.rs.
2023-02-13 20:00:35 +09:00
Jeong YunWon
fb4bc89812
Merge pull request #4492 from DimitrisJim/doc_parser_uno
...
Document parser crate.
2023-02-13 17:25:14 +09:00
Dimitris Fasarakis Hilliard
66cbe3fe62
Document parser crate.
2023-02-12 17:58:19 +02:00
Dimitris Fasarakis Hilliard
7714c5f517
Add tests, some comments, to function.rs.
2023-02-11 23:07:57 +02:00
Dimitris Fasarakis Hilliard
e6f361d2a5
Refactor: Join string and string_parser.
2023-02-11 18:05:06 +02:00
Jeong YunWon
4ee4fcf407
Add test_generator_expression_argument
2023-02-11 05:20:39 +09:00
Charlie Marsh
dc78f6033b
Use entire range for generators-as-arguments
2023-02-10 10:39:40 -05:00
Dimitris Fasarakis Hilliard
31e0962c66
Document lexer.
2023-02-07 21:43:57 +02:00
Dimitris Fasarakis Hilliard
639e8fc52f
Move NewLineHandler inline, don't check each character twice.
2023-02-07 20:58:53 +02:00
Jeong YunWon
00dc7ec709
use workspace dependencies
2023-02-06 15:30:38 +09:00
Dimitris Fasarakis Hilliard
bff9884df1
Hint that the unwrap should always succeed.
2023-02-01 12:17:33 +02:00
Dimitris Fasarakis Hilliard
c8005694c7
Eat for comma.
2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
d4de01c500
Add initial capacities, use u32s for indents/spaces.
2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
2a4d44d667
Don't call is_emoji_presentation for each invocation of consume_normal
2023-01-31 12:26:05 +02:00
Dimitris Fasarakis Hilliard
f4831432f9
Match on ascii start/continuation characters before calling functions.
2023-01-31 12:26:05 +02:00
Aarni Koskela
bdc0e257b1
Bump phf to 0.11 series
...
string_cache is still using phf_shared 0.10.0 though
2023-01-25 19:58:43 +02:00
Jeong YunWon
1304e4ba2f
Merge pull request #4449 from harupy/fix-dict-spread-in-dict
...
Fix AST generated from a dict literal containing dict unpacking
2023-01-22 20:44:26 +09:00
harupy
c157dff454
Fix comment
2023-01-22 00:06:52 +09:00
Anders Kaseorg
b93b23b922
Fix end location for elif blocks
...
Since we parse an `elif:` block as an `If` node, its location should
include its `orelse` node like it would for an `if:` block.
Signed-off-by: Anders Kaseorg <andersk@mit.edu>
2023-01-17 22:39:44 -05:00
harupy
f260785da4
Remove useless String::from
...
Signed-off-by: harupy <hkawamura0130@gmail.com>
2023-01-16 21:27:57 +09:00
harupy
d83e3ee8cd
Revert "Simplify compile_dict"
...
This reverts commit b31b08a30eb24e246b7f0a0d69b2b5e56a7e7a40.
2023-01-16 01:27:54 +09:00
harupy
4f32bacf9c
Rename test
2023-01-15 23:36:07 +09:00
harupy
6bda1a9e9e
Simplify compile_dict
2023-01-15 23:20:00 +09:00
harupy
64736d0541
Simplify scan_expression
2023-01-15 22:08:19 +09:00
harupy
a7f1904564
Improve test
2023-01-15 16:53:13 +09:00
harupy
d7f5dadf47
Add Option to Dict.keys field
2023-01-15 16:43:13 +09:00
harupy
2f4fe8b380
Remove commented-out code
2023-01-15 16:10:51 +09:00
harupy
f8ae56c75b
Fix clippy errors
2023-01-15 15:04:15 +09:00
harupy
cb3578dbf2
Fix scan_expression and compile_dict
2023-01-15 14:54:58 +09:00
harupy
375d592562
Fix scan_expression and compile_dict
2023-01-15 13:22:05 +09:00
harupy
5e7b909552
Fix unparse
2023-01-15 13:11:55 +09:00
harupy
52d2e25601
Fix dict spreading in dict literal
2023-01-15 13:01:59 +09:00
Jim Fasarakis-Hilliard
163cb5cd67
Merge pull request #4443 from bluetech/non-logical-newline-token-fixup
...
Fixup parse_tokens after "Add NonLogicalNewline token"
2023-01-14 12:49:04 +02:00