Unset Avatar

Example: When I uploaded the picture set for my avatar I did not have a copy of a good picture for myself to use. I have since setup a picture at gravatar and would like to switch to using that instead of the one currently being used, however the only way I can do that is to upload a new picture instead of just unsetting the current one.