The Ancient OneJoined: Sat Oct 20, 2007 10:31 amPosts: 3399Location: Last house on the Right

Oberon wrote:

Did they all have to sign up for the site or didyou (Spud) create them to have Dead Donkey to be more searchable?

Google does not support "warez" in contrast to Baidu for instance. If they knew what this site is about they would remove it from their databases.

By the way I've just read a book about Google. They store everything you search for several years. They use it (as they state) to improve and personalize their search results and addvertisement "products" like AdWords and AdSense. In the future (and thanks to paranoid Mr. Bushnutte) this information could be used by the government or police authorities. Just make sure you don't enter something like "sharp knives" into Google before you plan to kill someone. Google denies that it is giving the database content to third parties but their cooperation with the Chinese government considering the indexing of their content and several other reports pretty much proove they do. And they have to if a shitty paranoid goverment creates shitty paranoid laws anyway.

They have to get a court order at the least, and several governments in south america have asked for the info from google and google, very nicely, told them to go f*ck themselves.

China has got small sets of data from them, but nothing on the scale of yahoo and aol has handed over... yet.

@registering, no browsers identify themselves with a http header that identifies their 'agent'. So when it see's agent as Googlebot it identifies them as a bot. it then turns off things like sessions, login checks, etc so its easier on the site. you can turn it off and it will just appear as another unregistered 'leech' , however its not as efficient.

Basically, google and other search engines, for better or for worse, have clusters of machines that 'spider' sites... that is go through, consume lots of bandwidth and index an entire site by virtually 'clicking' every link in and out. It does things like calculate a site ranking based on content hits and incoming and outgoing links.

So the best thing you can do for dead-donkey.com is stick it in your signature at other sites, because when they are indexed it will see a link to dead-donkey and say its a better site based on the number of links.

Nice link. I read through a couple of horror stories of Googlebot eating up 1-2GBs ofbandwidth in a short period of time. Assuming bandwidth is at a premium (which I don'tknow if it is for you) is it worth it? I see what you are saying about traffic and hits butif 30%-50% of traffic is from a bot(s) then that seems like a really high price to pay. Fromwhat I've been reading, Googlebot scans on a daily basis? That also seems a little extreme.

Who is online

Users browsing this forum: No registered users and 1 guest

You cannot post new topics in this forumYou cannot reply to topics in this forumYou cannot edit your posts in this forumYou cannot delete your posts in this forumYou cannot post attachments in this forum