Wish I could help, sounds like a problem the Destiny beta had. Does it help if the party gets connected at the dashboard before starting the game? Take a look at the Destiny board, but I think that was the solution to that problem.

I just wish our party of 3 in any game would stay connected. We all have open NAT but MS doesn't seem to think there are any problems since TF came out.