nocfed wrote:
On 3/25/06, Jorrit Kronjee <full-disclosure@xxxxxxxxxxxxxxxx> wrote:nocfed wrote:You have failed to understand the 'hint' part. It was a hint at ONE of the switches to use.. As you apparently have not read the manpage for wget, here is the full command. wget -e robots=off -Hr -nd -np --domains=72.14.203.104 -U Mozilla http://www.elsenot.com/frsirt-google.htmlAt the risk of stating the obvious and hopefully putting an end to this thread, http://www.frsirt.com/robots.txt doesn't contain /exploits/ ? So what's your point? - Jorritwget is not crawling nor attempting to request anything form frsirt. google on the other hand DOES use robots which wget will honor bydefault.
Agreed, sorry for the confusion. - Jorrit _______________________________________________ Full-Disclosure - We believe in it. Charter: http://lists.grok.org.uk/full-disclosure-charter.html Hosted and sponsored by Secunia - http://secunia.com/