This is the mail archive of the
mailing list for the Cygwin project.
Re: Wget ignores robot.txt entry
On 14 Feb 2003, Randall R Schulz <firstname.lastname@example.org> wrote:
> Wget [...] seems to have it
> all over cURL. (Sure. Go ahead and prove me wrong.
Wget has fewer protocols (one can argue whether the extra
protocols are worthwhile, but there y'go), can't do uploads
AFAICS, and HTTP POST also doesn't seem to be mentioned. OTOH
Wget has features that cURL does not; they're not better &
worse, just different.
Unsubscribe info: http://cygwin.com/ml/#unsubscribe-simple
Bug reporting: http://cygwin.com/bugs.html