Welcome to Hui Wu's website

Research Scientist, IBM Research AI

Semantic-aware Food Visual Recognition

Semantic-aware Food Visual Recognition

The growing popularity of fitness applications and people’s need for
easy logging of calorie consumption on mobile devices has
made accurate food visual recognition increasingly desireable.
In this project, we proposed a visual food recognition framework that integrates
the semantic relationships among fine-grained food classes.

Our framework learns semantics-aware features by formulating
a multi-task loss function on top of a convolutional
neural network (CNN) architecture [1,2]. It then refines the CNN
predictions using a random walk based smoothing procedure,
which further exploits the rich semantic information.
A close variant of this basic idea was integrated to
Watson Visual Recogntion API. Just for fun, here is what the model says
about blueberry muffins and puppies.