Re: [Full-disclosure] Re: Re: Re: Links to Google's cache of626FrSIRTexploits

[nocfed <nocfed@xxxxxxxxx>]

On 3/25/06, Jorrit Kronjee <full-disclosure@xxxxxxxxxxxxxxxx> wrote:
> nocfed wrote:
> >
> > You have failed to understand the 'hint' part.  It was a hint at ONE
> > of the switches to use..
> >
> > As you apparently have not read the manpage for wget, here is the full 
> > command.
> >
> > wget -e robots=off -Hr -nd -np --domains=72.14.203.104 -U Mozilla
> > http://www.elsenot.com/frsirt-google.html
>
> At the risk of stating the obvious and hopefully putting an end to this
> thread, http://www.frsirt.com/robots.txt doesn't contain /exploits/ ? So
> what's your point?
>
> - Jorrit
>

wget is not crawling nor attempting to request anything form frsirt. 
google on the other hand DOES use robots which wget will honor by
default.

_______________________________________________
Full-Disclosure - We believe in it.
Charter: http://lists.grok.org.uk/full-disclosure-charter.html
Hosted and sponsored by Secunia - http://secunia.com/