The thing that most worries me is that they'll lose actors (and have to replace them with others) if the series goes too many seasons. Related to that is the question of whether and how quickly Martin can get the remaining books out.

We know they've been given the go-ahead for season 4 and that this will probably take us through the second half of the third book, but after that, it gets funky.