mirrors/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-09-27 02:39:58 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

[3.12] gh-105324: Fix tokenize module main function for stdin (GH-105325) (#105330)

Browse source
This commit is contained in:
Miss Islington (bot) 2023-06-05 12:44:20 -07:00 • committed by GitHub
parent ab660e9a53
commit 3aa3be4fe3
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 3 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

3
Lib/tokenize.py
View file

@ -490,8 +490,7 @@ def main():
else: else:
filename = "<stdin>" filename = "<stdin>"
tokens = _generate_tokens_from_c_tokenizer( tokens = _generate_tokens_from_c_tokenizer(
(x.encode('utf-8') for x in iter(sys.stdin.readline, "") sys.stdin.readline, extra_tokens=True)
), "utf-8", extra_tokens=True)
# Output the tokenization # Output the tokenization

2
Misc/NEWS.d/next/Core and Builtins/2023-06-05-17-35-50.gh-issue-105324.BqhiJJ.rst Normal file
View file

@ -0,0 +1,2 @@
Fix the main function of the :mod:`tokenize` module when reading from
``sys.stdin``. Patch by Pablo Galindo