mirrors/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-09-27 10:50:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

Fix issue #15899: Make the unicode.rst doctests pass. Patch by Chris Jerdonek.

Browse source
This commit is contained in:
Senthil Kumaran 2012-09-11 03:17:52 -07:00
parent c8754a13e6
commit 2fd8bdbc9d
1 changed files with 13 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

25
Doc/howto/unicode.rst
View file

@ -257,13 +257,13 @@ converted according to the encoding's rules. Legal values for this argument are
'REPLACEMENT CHARACTER'), or 'ignore' (just leave the character out of the 'REPLACEMENT CHARACTER'), or 'ignore' (just leave the character out of the
Unicode result). The following examples show the differences:: Unicode result). The following examples show the differences::
>>> b'\x80abc'.decode("utf-8", "strict") >>> b'\x80abc'.decode("utf-8", "strict") #doctest: +NORMALIZE_WHITESPACE
Traceback (most recent call last): Traceback (most recent call last):
File "<stdin>", line 1, in ? ...
UnicodeDecodeError: 'utf8' codec can't decode byte 0x80 in position 0: UnicodeDecodeError: 'utf-8' codec can't decode byte 0x80 in position 0:
unexpected code byte invalid start byte
>>> b'\x80abc'.decode("utf-8", "replace") >>> b'\x80abc'.decode("utf-8", "replace")
'?abc' '<EFBFBD>abc'
>>> b'\x80abc'.decode("utf-8", "ignore") >>> b'\x80abc'.decode("utf-8", "ignore")
'abc' 'abc'
@ -301,9 +301,9 @@ XML's character references. The following example shows the different results::
>>> u = chr(40960) + 'abcd' + chr(1972) >>> u = chr(40960) + 'abcd' + chr(1972)
>>> u.encode('utf-8') >>> u.encode('utf-8')
b'\xea\x80\x80abcd\xde\xb4' b'\xea\x80\x80abcd\xde\xb4'
>>> u.encode('ascii') >>> u.encode('ascii') #doctest: +NORMALIZE_WHITESPACE
Traceback (most recent call last): Traceback (most recent call last):
File "<stdin>", line 1, in ? ...
UnicodeEncodeError: 'ascii' codec can't encode character '\ua000' in UnicodeEncodeError: 'ascii' codec can't encode character '\ua000' in
position 0: ordinal not in range(128) position 0: ordinal not in range(128)
>>> u.encode('ascii', 'ignore') >>> u.encode('ascii', 'ignore')
@ -331,12 +331,11 @@ point. The ``\U`` escape sequence is similar, but expects eight hex digits,
not four:: not four::
>>> s = "a\xac\u1234\u20ac\U00008000" >>> s = "a\xac\u1234\u20ac\U00008000"
^^^^ two-digit hex escape ... # ^^^^ two-digit hex escape
^^^^^ four-digit Unicode escape ... # ^^^^^^ four-digit Unicode escape
^^^^^^^^^^ eight-digit Unicode escape ... # ^^^^^^^^^^ eight-digit Unicode escape
>>> for c in s: print(ord(c), end=" ") >>> [ord(c) for c in s]
... [97, 172, 4660, 8364, 32768]
97 172 4660 8364 32768
Using escape sequences for code points greater than 127 is fine in small doses, Using escape sequences for code points greater than 127 is fine in small doses,
but becomes an annoyance if you're using many accented characters, as you would but becomes an annoyance if you're using many accented characters, as you would