bpo-33899: Mention tokenize behavior change in What's New (GH-10073)

This commit is contained in:
Tal Einat 2018-10-24 10:20:05 +03:00 committed by Gregory P. Smith
parent c46db9232f
commit dfba1f67e7
3 changed files with 21 additions and 0 deletions

View file

@ -2414,3 +2414,11 @@ Notable changes in Python 3.6.5
The :func:`locale.localeconv` function now sets temporarily the ``LC_CTYPE`` The :func:`locale.localeconv` function now sets temporarily the ``LC_CTYPE``
locale to the ``LC_NUMERIC`` locale in some cases. locale to the ``LC_NUMERIC`` locale in some cases.
(Contributed by Victor Stinner in :issue:`31900`.) (Contributed by Victor Stinner in :issue:`31900`.)
Notable changes in Python 3.6.7
===============================
In 3.6.7 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token
when provided with input that does not have a trailing new line. This behavior
now matches what the C tokenizer does internally.
(Contributed by Ammar Askar in :issue:`33899`.)

View file

@ -2507,3 +2507,8 @@ calling :c:func:`Py_Initialize`.
In 3.7.1 the C API for Context Variables In 3.7.1 the C API for Context Variables
:ref:`was updated <contextvarsobjects_pointertype_change>` to use :ref:`was updated <contextvarsobjects_pointertype_change>` to use
:c:type:`PyObject` pointers. See also :issue:`34762`. :c:type:`PyObject` pointers. See also :issue:`34762`.
In 3.7.1 the :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token
when provided with input that does not have a trailing new line. This behavior
now matches what the C tokenizer does internally.
(Contributed by Ammar Askar in :issue:`33899`.)

View file

@ -173,6 +173,14 @@ Added :attr:`SSLContext.post_handshake_auth` to enable and
post-handshake authentication. post-handshake authentication.
(Contributed by Christian Heimes in :issue:`34670`.) (Contributed by Christian Heimes in :issue:`34670`.)
tokenize
--------
The :mod:`tokenize` module now implicitly emits a ``NEWLINE`` token when
provided with input that does not have a trailing new line. This behavior
now matches what the C tokenizer does internally.
(Contributed by Ammar Askar in :issue:`33899`.)
tkinter tkinter
------- -------