thanks a bunch for the reply! Understood. The problem is that the footage is pretty long while the clip in premiere pro (or the comp length in AE) is only a couple seconds and it it's a waste of time to track the whole shot.
How do you pre-render a comp? Via render queue?

Also I thought I make a screenshot only for reference so you see what's going on: