More Like This

Quick Reference

A program which traverses a number of web pages following the hyperlinks and carrying out some process such as checking whether any Web pages have changed since the last visit. The most popular robots are spiders used by search engines that collect data stored in the databases used by the search engines for retrieving documents which match search criteria. The term is often abbreviated to bot.