I believe the Xubuntu installation doesn't have the necessary firmware for Bluetooth to work. There's a tutorial on the Gentoo Wiki for how to download the necessary firmware for Bluetooth, but I haven't tried it on Ubuntu.