language-servers/rust-analyzer
1
0
Fork 0
mirror of https://github.com/rust-lang/rust-analyzer.git synced 2025-10-03 15:15:24 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 3

Clarify and correct comment about multi_byte_tokens

Browse source
This commit is contained in:
DJMcNab 2018-12-08 14:46:15 +00:00 • committed by Aleksey Kladov
parent 3d3026dc60
commit 89cf7d8743
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
crates/ra_syntax/src/grammar.ron
View file

@ -25,9 +25,9 @@ Grammar(
["^", "CARET"], ["^", "CARET"],
["%", "PERCENT"], ["%", "PERCENT"],
], ],
// TODO: Confirm surmision: the tokens which cannot be recorded in a single UTF-8 byte // Tokens for which the longest match must be chosen (e.g. `..` is a DOTDOT, but `.` is a DOT)
multi_byte_tokens: [ multi_byte_tokens: [
[".", "DOT"], // Note: DOT is here because <TODO: REASON> [".", "DOT"],
["..", "DOTDOT"], ["..", "DOTDOT"],
["...", "DOTDOTDOT"], ["...", "DOTDOTDOT"],
["..=", "DOTDOTEQ"], ["..=", "DOTDOTEQ"],