Deleting Apps

Question: If I install an app and then moved it in my SD card then later on decided to uninstall it, does it completely get deleted from the SD card? Because when I try to install the app again, I kept on getting an error when I try to move it back in the SD card. Thanks!