Considering no experience, it would pay to spend a day somewhere calm, sheltered with minimal current getting used to being in a kayak. Tipping yourself out and getting back in etc. Brush up on a bit of safety, it's #1. Perhaps go to a club meetup somewhere near Waihi or Tauranga and see if you can go out with a few others who are willing to share some of that knowledge.

As for spots, maybe someone who fishes in that area can tell you - search the forums, search the other fishing forums, or just trial and error, try a few places out.

As for spots, the beauty of a kayak is everywhere has the potential to catch fish due to stealth and access. Good rule of thumb is look at where locals go surfcasting or rock fishing and sit just outside of their casting range and you'll most likely get something.

find a safe place, jump out of your yak & try & get back in it, there is a technique to do it, believe me, its not easy till you know how
the weekend comp I was in, there was mention last year in that comp, a fala tipped out in the sea, could not get back on his yak, nearly drowned