mirrors/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-07-24 11:44:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 8

bpo-31394: Clarify documentation about token type attribute (GH-3469)

Browse source 
Make it clear that Ellipsis tokens also have type attribute set to token.OP.
This commit is contained in:
Aivar Annamaa 2017-09-13 06:24:03 +03:00 • committed by Mariatta
parent 3bcf157c11
commit 5f8fbf917e
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
Doc/library/tokenize.rst
View file

@ -16,8 +16,8 @@ implemented in Python. The scanner in this module returns comments as tokens
as well, making it useful for implementing "pretty-printers," including
colorizers for on-screen displays.
To simplify token stream handling, all :ref:`operators` and :ref:`delimiters`
tokens are returned using the generic :data:`~token.OP` token type. The exact
To simplify token stream handling, all :ref:`operator <operators>` and :ref:`delimiter <delimiters>`
tokens and :data:`Ellipsis` are returned using the generic :data:`~token.OP` token type. The exact
type can be determined by checking the ``exact_type`` property on the
:term:`named tuple` returned from :func:`tokenize.tokenize`.