bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686)

https://bugs.python.org/issue5028
This commit is contained in:
Anthony Sottile 2019-05-30 15:06:32 -07:00 committed by Miss Islington (bot)
parent eea47e0939
commit 2a58b0636d
3 changed files with 4 additions and 4 deletions

View file

@ -415,7 +415,7 @@ def tokenize(readline):
column where the token begins in the source; a 2-tuple (erow, ecol) of
ints specifying the row and column where the token ends in the source;
and the line on which the token was found. The line passed is the
physical line; continuation lines are included.
physical line.
The first token sequence will always be an ENCODING token
which tells you which encoding was used to decode the bytes stream.