Comments on: How do I see it ALL???http://ask.metafilter.com/54830/How-do-I-see-it-ALL/
Comments on Ask MetaFilter post How do I see it ALL???Thu, 11 Jan 2007 09:37:42 -0800Thu, 11 Jan 2007 09:37:42 -0800en-ushttp://blogs.law.harvard.edu/tech/rss60Question: How do I see it ALL???http://ask.metafilter.com/54830/How-do-I-see-it-ALL
Google: Is there any way to see all 35k results for a search term in video.google.com instead of just the first 500 or so? At some point, clicking on the following page of results, Google yields a blank page.post:ask.metafilter.com,2007:site.54830Thu, 11 Jan 2007 08:39:43 -0800Clementines4evergooglevideosearchBy: MetaMonkeyhttp://ask.metafilter.com/54830/How-do-I-see-it-ALL#825740
Assuming this is a similar problem to the limit of ~1000 results to a normal google search (i.e. at google.com), the only known method is to refine your search by adding additional terms. So instead of searching for "'star trek'", search for "+'star trek' +spock".<br>
<br>
The theory is that google imposes a hard limit to save on processing.comment:ask.metafilter.com,2007:site.54830-825740Thu, 11 Jan 2007 09:37:42 -0800MetaMonkeyBy: alopezhttp://ask.metafilter.com/54830/How-do-I-see-it-ALL#825810
<i>The theory is that google imposes a hard limit to save on processing.</i><br>
<br>
This is not a theory; it's a fact that computing the exact set of pages is an expensive computation (particularly for conjunctive/disjunctive search terms). The reason that the first page of results on Google says "Results 1 - 10 of <i>about</i> 35,000 for foo" is because the number 35,000 is an estimate, not an exact count. In fact, computing better estimates is an active area of research at the search companies.comment:ask.metafilter.com,2007:site.54830-825810Thu, 11 Jan 2007 10:29:48 -0800alopezBy: Doofus Magoohttp://ask.metafilter.com/54830/How-do-I-see-it-ALL#825870
<b><blockquote>At some point, clicking on the following page of results, Google yields a blank page.</blockquote></b></blockquote>That happens when you hit result #1001. There's no way to retrieve anything beyond their first 1,000 results, even using the API.comment:ask.metafilter.com,2007:site.54830-825870Thu, 11 Jan 2007 11:20:48 -0800Doofus Magoo