If you used the Rounded Rectangle Auto shape, then you can adjust it by sliding the yellow dots at its corners, or by means of the Auto Shape Properties panel. If you used the regular rectangle tool, you can use the corner roundness slider on the Properties panel. If you have ungrouped the rectangle (either kind), you will no longer be able to adjust the corner radius.