Overrides Crawler4J methods in WebCrawler to enable
restriction to a named host and to connect to the
Terrier index.
This class auto-configures by overriding variables normally loaded from the
terrier.properties file as follows: