Wouldn't that be the way It was In real life, The attacker will naturally attack the weakest section.
It's then upto the defender to breach the gap with the right troops on the principal of It's easier to defend than to attack.
Or an expendable cavalry force to destroy expensive siege equipment and troops.