mirrors/cpython
1
0
Fork 0
mirror of https://github.com/python/cpython.git synced 2025-08-23 18:24:46 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 11

#17403: urllib.parse.robotparser normalizes the urls before adding to ruleline.

Browse source 
This helps in handling certain types invalid urls in a conservative manner.
This commit is contained in:
Senthil Kumaran 2013-05-29 05:54:31 -07:00
parent eb4c9c77b8
commit c70a6ae49b
3 changed files with 17 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

12
Lib/test/test_robotparser.py
View file

@ -234,6 +234,18 @@ bad = ['/some/path']
RobotTest(15, doc, good, bad)
# 16. Empty query (issue #17403). Normalizing the url first.
doc = """
User-agent: *
Allow: /some/path?
Disallow: /another/path?
"""
good = ['/some/path?']
bad = ['/another/path?']
RobotTest(16, doc, good, bad)
class NetworkTestCase(unittest.TestCase):