This is usually due to the mp3 codec being missing. Try running banshee from a terminal and when you try to play an mp3 it should display an error in the terminal window. It'll probably be that gstreamer plugins are missing, if so you can fix it by installing gstreamer-plugins-good, gstreamer-plugins-bad, gstreamer-plugins-ugly.