The DELETE statement conflicted with the REFERENCE constraint
FK_EntityA_inherits_BaseEntity". The conflict occurred in database
"MyDB", table "dbo.BaseEntitySet_EntityA", column 'Id'. The statement
has been terminated.

How do I fix this?

UPDATE

I noticed a difference between how VS2010 and VS2012 model designer outputs SQL.