Apps saved to SD card on Note 2, how do you transfer/remove the apps to/from Note 4?

Sorry if the title wasn't clear. I had apps saved to my SD card on my old Note 2. My Note 2 died and I got a 4. However, I haven't re-downloaded all the apps that I had on my Note 2. If I want to clear out that space that the apps took from my SD card do I have to manually go into each app folder that was created and delete them via Windows Explorer? Or can they be wiped through the phone?

I always start fresh with my sd card i transfer all my pics and music and stuff to my computer and format the card on the new phone and then put everything back on it...almost like have a new sd card...takes time but at least i have a recent backup and no sd card isssues