Web crawler visit frequency and depth are calculated by a set of adaptive algorithms that the search engine developers prefer not to disclose. When you run an advertisement campaign to promote your goods or services over the Internet, or even just update your website content, it is important to understand in what way and how fast these changes will be seen by the search engines.