I think you misinterpreted. Iím never said everybody or you. This was an observance with some people who were recently having problems. Remember with statistics and any analysis there are always cases to disprove the hypothesis. Rarely do you find a 100% consensus with anything especially in Google. You can disprove all theories with a lone case. Itís the percentage you observe.

I think you need to read the many threads where people claimed just changing anything cost them rankings.

"Then one day it dawned on me that Google wasn't evil and I realized that Google didn't care much about the way a page is arranged"

Well that maybe your perspective BillyS, but I've seen more than one of my sites go from number 19, page two to number three on page one on google for major keywords by simply making a title plural from singular.

Many times I've thought to "tweak" a page that really didn't need it, only to have it drop rank. Now I always keep a copy of the old page in on the server ( EG. index_old ) just case I have to pop it back in to pay the bills ;~)

In my experience, changing a page template is very different from tweaking the content of a page.

Clients have made some fairly extreme template changes, including changing from a tables-based layout to css relative positioning (which included moving some top nav down to the bottom of the code), with no apparent ranking effects at all. But in these redesigns, no text changes, url changes, or navigation changes were made.

On the other hand, changing a few key phrases on some pages has sent the rankings of the pages cycling up and down for weeks. Other onpage text changes have had no effect in rankings at all.

I'd say that the volatility of a page with regard to text changes depends on how competitive the phrases in question are, how close on your tail your competition is, how much of your positioning is due to onpage vs off-page factors (and how strong your inbound linking is), how close you are to tripping an overoptimization filter, where on the page you're making the change, and the timing of when this happens in relation to whatever Google is "tweaking" in its algo.

I just checked our google account (the manage webites) and I just discovered that lots of our sites pages, including our home page couldn't be crawled.

Help is there anything I can do?

Is this the same problem as everyone else

This page lists URLs from your site that Googlebot had trouble crawling. As a result, these pages have not been added to our index, and may not appear in Google search results. Googlebot found these pages either in your Sitemap or by following links from other pages during a discovery crawl.

Not all errors may be actual problems. For example, if pages are blocked by robots.txt, this may be because you've deliberately chosen to block them; if that's the case, there's no need to fix the error. Similarly, if unrecognizable URLs appear in the 404 report, it's fine to ignore them. However, it's still worthwhile to review any errors you receive, and to examine any affected pages for problems. For example, Not Followed errors can be a clue that some of your pages contain content (such as Flash or images) that Googlebot can't easily crawl, or that their URL structure is not Google-friendly.

I doubt that that's the same problem others are having, oasisfan. I'd start checking your server logs to see what they say has been going on with googlebot requests. You might have a technical problem - or you might recently have had a technical problem that's been cleared up.

Oasisfan - just a stab in the dark but it would not surprise me if you find that the Google message is not being created by your site but by others creating links to your site. We know that Google is looking to generate search box queries but these can be created remotely and if they do not resolve properly then this would generate an apparent error on your site. I have seen some evidence of this on one of my smaller site's logs and it seems that Google have opened themselves up to another possible exploit.

Has anyone else seen a major slow down in crawling since 1 June? I've seen my site and my competitors cache not updated since that time when usually I would notice changes on a daily basis being reflected on the SERPS and cache.

Oasis Fan - an example - I create a page of links to a well known auction site and that auction site accepts a search query link. Google spiders my page and then adds the links for its subsequent crawl BUT if I did the same to another site that does not accept a search query link then Google would not find these pages they would be 404's or Google may have a difficulty because of how your server set up processes the incoming request!

Having re-read your post then can you not see the specific pages that Google is having a problem with? You should be able to but I only have one warning at the moment for a page missing from a sitemap on one site BUT it does tell me the specific page. Can you not see the construct of the pages that it is having difficulty with? If you do not recognise the construct then it is probably being generated remotely for an unknown purpose.

I have a current rogue scraper trying all sorts of constructs on one small site, my guess is thay are trying to get my site to create in effect a mash of my content for use on their site. If they backlink to it and then Google spider their mash page of my content then I get a new page in the index that I did not want. I know of one widely used site plugin that uses this approach to bolster their content because I was able to track down the footprint of the request and then found what my and other sites had in common - their plugin!

Clients have made some fairly extreme template changes, including changing from a tables-based layout to css relative positioning (which included moving some top nav down to the bottom of the code), with no apparent ranking effects at all. But in these redesigns, no text changes, url changes, or navigation changes were made.

Absolutely, thatís the way you do it. But what I'm seeing now is a change in direction. Itís like in some cases Google is wrongly identifying certain elements of a page design as suspicious or skipping over it for some reason.

In ten years I've never had a problem with an old page being picked up, or even showing in the first 100 search results. But any action I've had to take is generally taken within days. If the new page does all right the old one goes into an archive. If the new page tanks, the old one goes right back up with a simple name change, the new one dumped.

I use the same methods Lovejoy and have accidentally left pages on servers with no ill effects. A month ago I cleaned it all out which was about five pages. Now I wish Google would police its on back yard. Google loves that duplicate content on scrapers. To be more accurate Google just plain loves stolen content with Adsense on it. I say this because I am dealing with absolutely none of this in MSN and Yahoo. Regardless of what Google maintains about it not hurting a site its to their advantage people not filing DMCA's against it.

To be more accurate Google just plain loves stolen content with Adsense on it. I say this because I am dealing with absolutely none of this in MSN and Yahoo.

I've seen just the opposite, but we may be talking about different things. Yes, I do see Google Adsense a lot on pages with scraped content.

What I don't see as much in Google, though, is scraped content having a longterm effect on the original page's rankings. Sometimes, a scraped page will flicker in and out for a few days on Google, but (thus far), the originals have always come back.

On the other hand, on MSN in particular, I've experienced scraped pages with a bunch of junk links taking down an entire well-establish site.

I know what you mean by the flickering but plenty have now found exploits in Google.

The ones that are becoming particularly obnoxious to me in Google are those that steal the meta tags, make a thumbnail, and add a little bit of info such as PR rank, Alexa rank etc. Because there's so little to grap on to penalize many rank in the top fifty. They could pass any OOP filter. They're basically glorified doorway pages that nobody links to but seem to gain rankings because they aim a few links outward. None of these sites are particularly gunning for top rankings but settle for hundreds of pages doing just well enough to generate a healthy Adsense income.

All search engines have spam and doorway pages. Google though seems uniquely tied to overlooking whatever profits them in regards to stolen or hijacked content. Bottom line is Google's got incredible gall penalizing anybody for anything with all the things they're overlooking that profit them. MSN and Yahoo have no observable ties with the spammers I see nor can I loosely suggest they do by just an ordinary view of the page.

What I also wanted to say was that when I looked in google webmaster tools for our site they list the top keyword searches for our site.

They are obviously out of date as none of the keywords now show our site up. The page they use to show up in the top 10 for this particular search was probably one of the best on this search. I just don't know why its gone. It makes me wonder if its worth continuing with our site as I can say that some pages which have lost rank in the past were not that good and I can see why they lost positions. That didn't worry me.

But this is worrying as I can see that even if we produce brilliant pages for some reason google won't list them. I don't know what google is up to but this one baffles me and they are not returning the best, in our particular field anyway, pages to searchers.

We have been compleatly open with google and have submitted our site through their webmaster tools dashboard. They know all about our site, we have been compleatly transparent

Their adsense team have even emailed us to take part in their surveys (OK I suspect many others would have taken parts) but still we have done nothing but fully co operate with google and followed their doctrin of basically "if you build it they will come".

I do also accept that maybe we have inadvertently done something wrong but I don't know what.

We have basically made our site look more modern and useable with breadcrumb navigation. Our site is 10 years old and this is our third major redesign to keep it up with the times. We are really pleased with how it looks and have used Css throughout. Its taken a year to update as we have done it page by page and also updated the content as we go. It a 1400 page site so it couldn't be done overnight. OK not that big a site but its all written by ourselves and we have thousands of photos.

I have joined the supporters forum and will submit our site to review.

We still have google page rank and some top 10 results but for others we are in the cold.

In your redesign what exactly did you do in terms of changing URLs, titles, descriptions, H1 tagged words etc?

You may have inadvertently changed something minor that has made a significant difference on Google.

Sometimes when moving to css positioning folks tidy up their tags, including H1 tags to correct errors in earlier coding, sometimes the document flow is different so your search terms are more or less prominent, or at least more or less dense early in the document. Take a look at an old page compared with the equivalent new page using lynx or a lynx simulator or a "how a robot sees your page" tool. It might show up some differences.

If it does your problems then really begin because you have to decide what if anything you are going to do about it.

we did use css before but one of the reasons we redesigned was taht it looked ok in I.E we had terrible positioning problems in firefox. As firefox became more and more popular we had to do something about it. We basiclaly left our URL's the same, just moved the content to the new design (which was done using Dreamwevar CS3). Now we have asite which looks OK in all browsers including safari. We didn't do anything with h1 tags or titles, just updated content where we needed to. I do accept we may have done something bad but as I said before we do pay little attention to seo as Google says that you should just design a page for users and ignore search engines. This is what we have done. I'll do as you say and take a look at the page but I thought google's bots were intelligent enough to have see the content in the order it is presented on the screen, not neccessarily in the raw order its in the website without the css to format it?

The redesign has taken over a year. We started slowly to see if there was any major effect and as it seemed OK we gradully rolled out the ew design.

I do see what you are saying that maybe we have done something bad to our site as google sees it but as there seems to be other people in this June 4th traffic fall it may be something else?