Is it worth going to see if you haven't seen 1, 2 or the avengers yet?

I wouldn't say it'd massively spoil your enjoyment of the film, as each film is basically "Tony Stark faces a new threat" but there are references back to the first 2 films and one or two flashbacks to The Avengers. You might also find yourself wondering who this War Machine/Iron Patriot dude is.