Google News Archive Forum

Google has listed my index.html but I wanted to know how long it will be before the rest of the site is index. The date in the description of my site in google shows as July 6th, does it normally take this long for google to come back or is it possible it just doesnt loke my site?

It can take a couple of months. It's not unusual for the homepage to be grabbed first and then other pages picked up later on.

Get good inbound links with decent PR from quality sites and have patience. It's not a problem, it's just the way it works.

What's bothering me is that I'm working on a new site - slowly and gradually - that is NOT linked to from anyplace whatsoever and Google got the whole thing right off it seems. I have no idea how or when since there are no stats available with that hosting - but there those pages sit, right in the index and two are ranking not bad at all considering it's all under construction.

There's no set time or rule that we can know for certain - but it often does take a couple of months to get more than just the index page in.

There are those who think that visiting your new pages with the toolbar can get them in the index without any external links to the site. I haven't a clue whether this is true. Brett implied yes in a previous post but GG thinks not.

I started a new site in very early June and it had visits from quite a few bots about 2 weeks later. Google came to my site and only hit the index page. Same thing with Slurp. To this day, I haven't had the bots back to my site.

AltaVista Scooter came and indexed my whole site and I am listed there but that's it.

I don't have any text hidden, the site is very straight forward but they haven't been back. Maybe my HTML stinks or google is just afraid of me.

My other website gets hit almost everyday by google and I have a very good ranking but still nothing.

Please forgive my naivety on the subject… I have created a few small personal websites; my current project is the first real big go at a large audience website.

I put up the first 20 pages of the site in late may, and have added 100 since… 60 in late June… 40 this past week. I will continue to add pages in blocks of 20-60 at a time as I am working on a regional website, and it will take some time to cover the area.

My question is… Is it normal to get 4 weeks of nearly daily googlebot visits followed by, what is now a week of none? I should not say any necessarily… I am still getting a robots and index.htm request every other day, but nothing more.

I suppose this is normal for a new site with relatively few back links as of yet… but I have been wondering, and wanted to get some more input on what to expect (even though it sounds like I should expect the unexpected with google).

I recently also added a basic sitemap to the new site from an old site, which I will be closing soon. The old site is currently linking to the new site, and to each subsection (towns within the area I am creating the site for). Is this not a wise idea? Will googlebot penalize me for doing this?

Radiolabs, it seems like this is the normal pattern, it's just seems to be taking time in most cases - some just more than others and there can be a few reasons for that.

nwctwx, it's hard to tell with some things with any degree of certainty, but if you're not linking back to the old site you're most likely OK. How is the PR for the old site, and are there a lot of decent links pointing to it?

How about the new site? Any good links to it besides from your old sites? Do your older sites link to each other?

The old site has a PR of 3, it never was a huge draw, with a very select local market. There are 10 links pointing to the old site (mostly PR 2-4).

The new site has a few good links, 2 from local libraries, and 3 from local directories. The site is nowhere near complete, so I am being very selective on who I ask for links from at this point. The new site does not link to the old site, but links to a page which has links to the 5 sites I have created in the past year (including 2 from this past month I made for customers, excluding the old site which will be dead in September).

My "market" is fairly untouched by the internet and I already was seeing very good SERPS when the index (county) and each "sub index" (towns) were in the results.

Last Wednesday freshbot did the last major visit (grabbing the index and each main town), since then it has been sparse. I added a site map this past weekend, and am now just waiting for googlebot to go back to it's previous avtivities on the site...

Did it just visit robots.txt or has it started to grab pages? If pages were grabbed, you might get lucky and have them in the index within a few days. If you want googlebot to visit certain pages first, there is no guarantee but you might want to get external links to those pages and also make sure they are not buried deep down from the root directory.

Google actually came by and grabbed the whole site yesterday. Unfortunately my site went down, but I think google had finished what it was doing & hasnt been back since. Does google normally forget everything its spidered if it finds a site is down?

For my sites, I have noticed it takes about a week...give or take...for new / modified pages to show in the SERPS. This is great! What used to take a month now only takes a week. I have begun noticing this for the past 2-3 weeks. My sites are PR4?..if the tool bar is correct. Judging from what other have said, the strength of your site determines how regularly the GBOT visits. My sites are visited every 2-3 days.