Cancelled my cannon and built another gateway. I transitioned into a aggressive zealot push that might be all-inish in his eyes (well I was really planning to expand and keeping with the worker count)
After my failed push - He assumed that I was pretty much done that I "all-ined" but then came the 2nd push that made him rage.