Per the audio commentary on Prince Caspian, Miraz's castle was based off the Chateau du Pierrefonds. It ended up being cheaper to just build a castle of their own rather than film on location, but the Chateau was the original inspiration.