“People are going to put on you whatever they want to put on you,” Buress told GQ. “It is conflicting, because people think I’m like this amazing guy or something. I’m a decent guy,” he demurred.

According to the GQ story, Buress wouldn’t expand too much more on how his words led to renewed interest in the Cosby allegations — but he doesn’t completely shy away from the topic: In the recent premiere of his Comedy Central show, Why? with Hannibal Buress, he joked that he worries male hotel housekeepers are actually “Bill Cosby assassins.” “It’s not going down like that!” he said.

Read the full GQ story — which includes Buress talking about the Cosby backlash and dealing with his newfound fame — here.