I believe you're experiencing "coital headaches" otherwise known as "sexual headaches".
They're really not that uncommon, but if you are experiencing these headaches frequently, like more than a week or two, it would be a good idea to ask your doctor about it ( as awkward as it may be ) because it could be something serious.