Sure it is. When you download Reaper and install, there's a small checkbox on the bottom right that appears during the install process, labelled 'Portable'...that's what it does!
In fact, I've NEVER run it any other way than portable! :-)