Then begin the crawl by calling crawl() on the Crawler object
This method allows you to pass a callback which will be run once a successfuly request has been made to the url
The variables passed into this call back is the response from the request, and the url.