That's almost impossible to answer actually, since the music is adaptive to the player. Sometimes it will appear to come and go but it actually almost never fully leaves. Hopefully you won't notice it come and going unless it's for some narrative reason ... but I'll leave it at that in order to avoid spoilers!