@mattdipasquale I spoke with drbrain about this. The problem for me was related to where the different gems were installed. You can manually handle it with gem uninstall -i /path/to/gem/hard/to/remove , but he also proposed adding gem uninstall -f gem which would handle it no matter what. See here for a bit more: rubygems/rubygems#136