I think it's a pretty lame thing to do but I would ignore it and just keep in the back of my mind about what kind of person this really is. Now, if you owned the challenge, I'd be more irritated and probably take KB's advice.

But for the record, half the time I cache, I forget the exact date. But in the end I am no further than a day or two off.