But not before the city's hotels and tourism officials went on the offensive.

"Tom Brady comes to Buffalo once a year, and to pass judgment like that I think is just irresponsible at best," Bryan Drew, general manager of Embassy Suites, told CNN affiliate WIVB. "We've got some great hotels, especially here downtown."

The local tourism organization, Visit Buffalo Niagara, also took issue with Brady's slam.

The Mansion said on its Facebook page that it's "having a bit of fun" with the incident, using it to promote the Buffalo area. "Tom Brady is an exceptional athlete and, much like the Patriots, The Mansion also strives for excellence!"