State-of-the-Art Computer Vision Technologies

Posts tagged: Internet Vision

Face recognition in unconstrained environment is very challenging due to the variations in facial expression, face pose, light condition and occlusion (e.g. eye glasses or hair). A recent project led by Dr. Learned-Miller at University of Massachusetts, Amherst, published the test results on 13,000 images of faces collected from web. The results are described in an ROC curve. At 10% false positive rate, the best true position rate (recognition rate) is around 67%. That is, in 100 face images for one person, only 67 faces are correctly recognized as this person; in 100 faces images of other persons, 10 faces are incorrectly recognized as this person. Therefore there is still big gap between this performance and the requirements of security applications, for example, access control. But are these results useful for other practical applications?

After you upload a video to YouTube, one thumbnail image will be displayed linking to your video. A thumbnail image is usually small but it is very important. It delivers the first visual impression of your video to audience browsing millions of videos on the web.

Digitalsmiths is an intelligent video advertising start-up driven by visual and speech analysis of video content. It is different from ZuraVision, which embeds visual advertisements into videos. Digitalsmiths serves as an information extraction procedure by video content analysis. The extracted information is called “metadata”. How the metadata is used for ads dispatch and how the ads are embedded into videos are the tasks of video publishers.

According to Digitalsmiths, their technology:

Indexes video with an unprecedented sense of context, nuance and intelligence

Online video advertising combines a video and an advertising image/video

Nowadays almost all online ads are based on keywords extracted from text of a page, finding the most relevant ads and putting them up alongside the page, such as AdWords by Google. Can we have “Video AdWords” extracted directly from online videos?