I think there must be something messed up with my pf some where, I've installed nmap on another system and its giving me the same errors, both systems are using a very similar rule set.
The systems are running FreeBSD 7.1-STABLE build on Jan 22