This happened to my feed yesterday to the point where it was hitting it once every minute. It's still going today, but it looks like it has slowed. From looking through the logs, it looks like MSN is trying to determine the refresh rate of my feed (and ignoring a Last-Modified: header). I see it hitting more often during some hours, and then slowing, and now it seems as if it has settled on a constant once-every-five-minutes.

I am not on the A list like Jeremy, but I am
puzzled by how much crawing Google seems to do vs other spiders. I am new to this so I may be reading my stats wrong:http://blog.eronj.com/awstats/awstats.pl

I wonder if the MSN bot can read the sitemap.xml file, perhaps that would cool it off. I know MS said they fixed it, or were fixing it, but it still seems to be all over my site.

on August 26, 2005 03:10 PM

Disclaimer: The opinions expressed here are mine and
mine alone. My current, past, or previous employers are not responsible for what I
write here, the comments left by others, or the photos I may share. If
you have questions, please contact
me. Also, I am not a journalist or reporter. Don't "pitch" me.

Privacy: I do not share or publish the email addresses
or IP addresses of anyone posting a comment here without consent.
However, I do reserve the right to remove comments that are spammy,
off-topic, or otherwise unsuitable based on my comment
policy. In a few cases, I may leave spammy comments but remove any
URLs they contain.