Are you talking about the shot you shared on Discord with the trees in front of the building?Would you mind posting it again here?

Personally, and I think I did mention this, I would not try to 'rotoscope' (implying frame by frame masking) anything involving trees and leaves. I would use an Extract effect or different Keys and cut up the footage into logical parts and try to isolate / extract only the pieces I'd want.

You can then put all the 'pieces' back on top of each other to form the final "rotoscoped" shot if that makes sense?

What do you want to do with the trees, do you want to remove them (if so, what would you place where you cut them out)? Do you want to change their colour?

Since you are doing a pan-tilt-zoom (the camera stays in one spot and looks around), you could potentially 3D camera track the scene and paint the trees in for one frame and keep the shape of the matte (fairly) well in place.

I've done something very similar here for my 3D Scan tutorial (though I've done a much rougher job than what you are likely after):

Have you tried using an Extract or a Color Key effect to see what you could extract Anson?It might be very tricky though, some of the trees are very similar in colour to the buildings directly behind it. If you could shoot it from a slightly higher angle (so the trees stand out a little more against the backdrop) that might help.

Of course that depends on whether you are in a position to refilm or you have to make due with what you already have