Google News Archive Forum

I noticed something really strange today. On Google one of my sites has about 500 backlinks where as on AlltheWeb it has 79,000. I know Google only shows pr4+ links, but still it doesn't make much sense. Why is there such a discrepancy?

One thing I've noticed that is very different on Alltheweb & Google, is the number of 'mirror DMOZ sites' that end up indexed / stable in Alltheweb & not in Google.

That being only one example of what I'm sure are thousands of differences in the content, pages, and sites they both have indexed ( their db's aren't the same size, and Alltheweb has an XML program that I don't know how meshes with their web cralwed database.)

Those are just a few ideas, really. There could be any number of huge differences, for example, I have all my content in Google, while the other engines index no more than 50% on many sites, sometimes, nothing more than the home page of a 60+ page site.

Something I've noticed is that AllTheWeb's number seems to include links to all pages in the site, not just links to the home page. If there's a way to make ATW check the links to just one page I can't figure it out.

I don't know if this helps or not.... but this is something I noticed in the last google dance. I normally have had about 450 back links. During the dance, I checked, and at one point, I had 67,900. I was looking forward to a big PR 9! Well, an hour later, it settled back down to 560... a decent improvement.

Near as I can figure, for that hour, Google had not yet removed all the back links from my own pages. Not too familiar with ATW, but could they also include b/l from yourself.... and google does not?

I've noticed my competitor's sites have the same sort of ratios that you describe (many more links from ATW than from G.) Why does my site have more Google links than ATW?

I have a small 40-page commercial site with a PR5 and about 200 Google links and about 125 ATW links. I have had this ratio for at least the last 10 months or so. I have developed web links by hand with other webmsters. I have never submitted to either Google or ATW but have just relied on their robots to find my site. I also do much better on Google's SERPs (top 3 in my keyword) than on ATW.

Is it likely that those linked to me somehow aren't spidered by ATW? What is happening here?

For instance I run a site that has nearly every page in the yahoo directory and DMOZ (each page of the site has a biography of a celebrity). A site with a lot of links from sites to different sections will appear much differently between the two search engines.

What should you do? Make a web directory based on all those 71,000 sites that link to you, so that they get a PR boost, and then when you are PR9, please link to me. :)