You could try setting your Geoprocessing>Processing Extent equal to your polygon layer extents. This would keep them within the rectangular extent of the layer, but not sure of it limiting the extent to just a polygon in the layer.