It's pretty tough to downgrade your version without a lot of tinkering. Are you on a rooted Note? If so, I'll look up some tips for you (or you can do a Google search and find an XDA Developers page where I'm sure somebody has done this).

As far as I am aware, the only way to go back to a previous ROM is to flash it. Unfortunately, downgrading deletes user settings an Apps. You will end up with a bare bones system and have to set it all up again. It might be a good idea to see if you can root your current ROM and then backup all your apps and settings with Titanium. Then you will only need to restore these when back to your old ROM.