The problem was that I used a resample on the geo. it split up each polygon so the group perimiter selected all points. I used a divide before the resample set to “remove shared edges”. It removed all inner edges and solved the problem!