Interesting. I guess native speakers confuse it because they are pronounced the same way. As you know, Brazilians pronounce “passed” (pa-ssed) differently than “past”. But most of the time, Brazilians don’t even get to learn “go/drive/walk past”, because you won’t find this in textbooks.