Incorporating labeled features into image classification using generalized expectation PublicDeposited

Descriptions

Image classification is a difficult problem, often requiring large training sets to get satisfactory results. However this is a task that humans perform very well, and incorporating user feedback into these learning algorithms could help reduce the dependency on large amounts of labeled training data. This process has already been leveraged in text classification, through the incorporation of labeled features. Labeling features provides a much more informative form of feedback than existing vision feedback systems like active learning and relevance feedback. In this paper, I adapt the Generalized Expectation Criteria to incorporate labeled features into the more complex CRF model used for images. Experiments are performed using oracle selected features as a ﬁrst step towards showing the potential benefits of this kind of user feedback for image classification.