cpython/Tools/webchecker
Guido van Rossum 2237b73baf Several changes:
- Change the code that looks for robots.txt to always look in /, even
if the "root" path is somewhere deep down below.

- Add link processing in <AREA> tags.

- Change safeclose() to avoid crashing when the file has no geturl()
method.
1997-10-06 18:54:01 +00:00
..
mimetypes.py mime types guesser 1997-01-30 02:44:20 +00:00
README Basic README file 1997-01-30 03:24:00 +00:00
robotparser.py Skip Montanaro's robots.txt parser. 1997-01-30 03:18:23 +00:00
tktools.py Check in another copy of tktools.py... 1997-01-31 18:58:53 +00:00
wcgui.py Scroll to top of info window when done. 1997-05-09 03:19:29 +00:00
wcmac.py Tiny script to play with it on a Mac. 1997-05-28 16:09:02 +00:00
webchecker.py Several changes: 1997-10-06 18:54:01 +00:00

Webchecker
----------

This is a simple web tree checker, useful to find bad links in a web
tree.  It currently checks links pointing within the same subweb for
validity.  The main program is "webchecker.py".  See its doc string
(or invoke it with the option "-?") for more defails.

The module robotparser.py was written by Skip Montanaro; the rest is
original work.

Jan 29, 1997.

--Guido van Rossum (home page: http://www.python.org/~guido/)