He said he noticed this when Google sent him a warning that his traffic suddenly dropped. He noticed his authorship showed up for a specific blog post in the Google search results. He also said people were clicking on the number two results, not the number one result because of maybe his "stupid ugly face" (quoting the author).

Matt Cutts of Google took offense to the title, which reads "How Google Authorship decreased our traffic by 90%." Why? Well, Matt looked into it and he said the real reason is not because of his "ugly face" but rather because he was hit by the Penguin algorithm.