yeah, you can soften the clay up a bit and try to remove - but you'll have to dry it out longer to cure the mold before using. i recommend trying to use an air hose if you have access to air compressor - stream your air between the clay and plaster to try to release w/o damaging the plaster with tools. you can also use a damp sponge to remove clay from your plaster.