New Zealand coach Ricki Herbert plans to give Paraguay a hard time in Thursday's final Group F match as his side look to create another piece of history.

A draw could be enough to put the All Whites into the second round, providing Italy versus Slovakia finishes in a lower-scoring draw.

They have already drawn against the other two teams in Group F but Paraguay pose the greatest threat of them all with their attack-minded side.

But having worked hard to get themselves into the position they are now in - on the verge of qualifying for the last-16 for the first time - Herbert is not prepared to let the opportunity slip.

"I think it has been an outstanding World Cup. What we have done so far is incredible and it has gone pretty deep back home and we are all really proud," said Herbert.

"We haven't been on the world stage for 28 years (New Zealand's only other World Cup appearance saw them lose all three matches and concede 12 goals) and we wanted to be credible and get results - but we have a unique opportunity of taking it on step further. I don't think we will hold back. I think we are competitive - nothing else and no different to a lot of sides at this World Cup."