This is the mail archive of the
mailing list for the Cygwin project.
RE: Wget ignores robot.txt entry
- From: Richard Campbell <richard dot campbell at air2web dot com>
- To: "'cygwin at cygwin dot com'" <cygwin at cygwin dot com>
- Date: Fri, 14 Feb 2003 08:58:14 -0500
- Subject: RE: Wget ignores robot.txt entry
>Wasn't a patch applied to CVS HEAD of the wget repos only a few weeks ago.
>Thats what it looks like anyway.
A cursory scan through the cvs web interface shows a patch for an ftp
applied 4 weeks ago by someone who does not appear on most of the rest of
latest changes; everything except for that appears to be 8 months old or
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Bug reporting: http://cygwin.com/bugs.html