Water rudder

It's been many,many years since I flew off water and I was wondering if you have to have a water rudder. Old high wing trainer and Bee Gee floats (i'll get flamed for that). That's what I had success with before but was wondering if the rudder was a must?