You could try an "emerge unmerge alsa-drivers" (or whatever alsa packages you've installed). The removal should not hurt your soundcard, being you said that the kernel supports it just fine. Worst case senario, you might have to re-compile your kernel if for some reason the drive gets removed.. (it shouldn't happen though)