Simple answer, yes. Because the original screws protrude without the tripod ring, I got some small silver screws at the hardware store. You might want to take your adapter with you. Paint them black, if the aesthetics bother you. I used a sharpie.

I understand why you would want to remove it. On a small lens, the adapter with tripod ring looks clunky.