From my own experience at least, I run up against my mental "limitations" far sooner than I run up against my physical ones. Usually, when I work through my mental "limitations," I can keep going much longer physically than I had thought before.