Merged revisions 83449 via svnmerge from

svn+ssh://pythondev@svn.python.org/python/branches/release27-maint

................
  r83449 | georg.brandl | 2010-08-01 22:59:03 +0200 (So, 01 Aug 2010) | 9 lines

  Merged revisions 83238 via svnmerge from
  svn+ssh://pythondev@svn.python.org/python/branches/py3k

  ........
    r83238 | georg.brandl | 2010-07-29 19:55:01 +0200 (Do, 29 Jul 2010) | 1 line

    #4108: the first default entry (User-agent: *) wins.
  ........
................
This commit is contained in:
Georg Brandl 2010-08-01 22:00:39 +00:00
parent 86edb14057
commit 0ba1f01adf
3 changed files with 21 additions and 2 deletions

View file

@ -202,6 +202,20 @@ bad = ['/folder1/anotherfile.html']
RobotTest(13, doc, good, bad, agent="googlebot")
# 14. For issue #4108 (obey first * entry)
doc = """
User-agent: *
Disallow: /some/path
User-agent: *
Disallow: /another/path
"""
good = ['/another/path']
bad = ['/some/path']
RobotTest(14, doc, good, bad)
class TestCase(unittest.TestCase):
def runTest(self):