After that date there was a succession of owners until the castle was surrendered with the manor to the Crown in 1487.

After this the castle gradually fell into decay and was mostly demolished due to its ruined state in the reign of King Henry VIII. The masonry of the only remaining tower is said to have been removed in 1795 to repair the bridge at Upton upon Severn.

No traces of the castle building now remain. A modern house which stood on some portion of the site was destroyed by fire in January 1904. The site is marked by tall conifers and a dry remnant of the moat ditch and bank.