Figure 3: Effect of on the decision boundary. The solid line () allows some training errors (red example on the top left is misclassified). The dashed line () does not allow any training error. Even though the case has one misclassification, it represents a trade-off between acceptable classifier performance and overfitting.