A surprising number of gems that are commonly used haven't yet been updated to be compatible with Rails 4 despite a pretty long beta/release candidate phase. Odds are you'll be seeing subtle errors for a while. You can check out the Github issues page to see if anybody mentions Rails 4 issues but problems aren't always documented.

Rails 3 might be an easier choice for some quick projects for a while because of this.