Ask those users to do a trace also. I once had this issue where only certain users were having problems on our site so I had them do traces and it turned out to be an upstream provider from our host was having problems and thus causing problems for those few users. I get fast, consistent pings to your site if I go from network-tools.com