This command will return a huge listing of all the visitable url`s on the http://www.google.com.au website. Give this a shot on other websites and see how you go. [email protected]:~$ wget –spider –force-html -r -l2 http://www.google.com.au 2>&1 | grep ‘^–‘ | awk ‘{ print $3 }’[email protected]:~$ wget –spider –force-html -r -l2 http://www.google.com.au 2>&1 | grep ‘^–‘ …