InfoSeek Robot 1.0

Its purpose is to generate a Resource Discovery database.
Collects WWW pages for both InfoSeek's free WWW search and
commercial search. Uses a unique proprietary algorithm to
identify the most popular and interesting WWW pages. Very
fast, but never has more than one request per site
outstanding at any given time. Has been refined for more
than a year.