21 commits

Author	SHA1	Message	Date
Pol Valletbó	b769f34f63	chore: move common code to function	2023-10-11 15:45:45 +02:00
Pol Valletbó	e1aeb7fa79	fix: handle errors for string byte string and c_string	2023-10-11 15:25:52 +02:00
Pol Valletbó	677e6f3439	fix: use unescape_byte function for Byte literals	2023-10-11 13:09:15 +02:00
Pol Valletbó	f58a8250dc	fix: cargo fmt	2023-10-11 12:36:53 +02:00
Pol Valletbó	1fe6ac87e9	add diagnosis messages for chars and byte literal errors	2023-10-11 12:19:00 +02:00
hkalbasi	f4704bc8ae	Switch to in-tree rustc dependencies with a cfg flag	2023-09-15 18:10:11 +03:30
Lukas Wirth	9b8eb807a3	Parse builtin# syntax	2023-09-05 10:36:35 +02:00
Lukas Wirth	4b577e2bc8	Support c string literals	2023-05-18 11:06:05 +02:00
Lukas Wirth	099b5b3b15	internal: Bump rustc_lexer	2023-05-18 10:17:40 +02:00
Lukas Wirth	4788c7a056	Bump rustc-ap-rustc_lexer	2023-02-08 11:42:14 +01:00
Yuri Astrakhan	1d59c7b667	Remove non-needed clones ... I am not certain if this will improve performance, but it seems having a .clone() without any need should be removed. This was done with clippy, and manually reviewed: ``` cargo clippy --fix -- -A clippy::all -D clippy::redundant_clone ```	2022-12-23 02:20:03 -05:00
Jonas Schievink	9bd11459ba	Revert "Auto merge of #12149 - jonas-schievink:literally-just-a-literal, r=jonas-schievink" ... This reverts commit cc9ae2b89e, reversing changes made to 7dfd1cb572.	2022-05-13 15:08:14 +02:00
Jonas Schievink	2fe38d3b63	Indicate the number of float tokens in the first token	2022-05-05 16:28:59 +02:00
Jonas Schievink	1bc3305d95	Split float literal tokens at the .	2022-05-05 16:28:58 +02:00
Jonas Schievink	1f50e19eb2	Add a Converter type for token conversion	2022-05-02 17:47:12 +02:00
Aleksey Kladov	f4cb0ff9be	internal: move ws attachment logic to the parser crate ... This has to re-introduce the `sink` pattern, because doing this purely with iterators is awkward :( Maaaybe the event vector was a false start? But, anyway, I like the current factoring more -- it sort-of obvious that we do want to keep ws-attachment business in the parser, and that we also don't want that to depend on the particular tree structure. I think `shortcuts` module achieves that.	2021-12-26 16:47:10 +03:00
Aleksey Kladov	74de79b1da	internal: rename	2021-12-25 22:02:26 +03:00
Aleksey Kladov	92dad471bc	Update crates/parser/src/lexed_str.rs ... Co-authored-by: bjorn3 <bjorn3@users.noreply.github.com>	2021-12-18 17:34:55 +03:00
Aleksey Kladov	a022ad68c9	internal: move all the lexing to the parser crate	2021-12-18 17:20:38 +03:00
Aleksey Kladov	78926027e3	converting lexed str to tokens	2021-12-18 15:36:21 +03:00
Aleksey Kladov	8b9d145dea	soa all the things	2021-12-18 15:31:50 +03:00

Renamed from crates/parser/src/lexer_token.rs (Browse further)