Yelp deems 20% of user reviews ‘suspicious’

A study of flagged write-ups shows how some try to game the system

CLARIFICATION: Though Yelp deems 20% to 25% of submitted reviews “suspicious,” a spokesman says these are filtered and unseen by the vast majority of users.

The office of New York’s Attorney General announced Monday that it fined businesses over $350,000 for generating phony reviews online. Consumers are right to be suspicious of online product, restaurant, and hotel reviews: According to a new report -- and the site itself -- up to 25% of all reviews posted on Yelp
YELP, +1.42%
are “suspicious” if not fraudulent.

On Monday, Attorney General Eric T. Schneiderman announced that 19 companies agreed to cease their practice of writing fake online reviews and pay hefty penalties for false advertising and deceptive business practices. Dubbed “Operation Clean Turf,” his investigation found that these businesses – ranging from bus companies to teeth whitening services — systematically tried to game the system by paying freelance writers from Philippines, Bangladesh and Eastern Europe between $1 to $10 per review. Schneiderman’s office cited a 2011 study by Michael Luca, assistant professor at Harvard Business School, which said a one-star rating hike on Yelp can mean a 5% to 9% rise in restaurant revenue.

Bloomberg

But the problem is even worse than the New York investigation suggests, Luca says. The number of possibly fraudulent reviews on Yelp rose from 5% in 2006 to 20% in 2013, according to “Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud,” a report by Luca that was co-written by Georgios Zervas, an assistant professor of marketing at Boston University -- and may now be as high as 25%. These filtered reviews can only be seen by clicking a link at the bottom of the each businesses’ page. As for the remaining 75% of reviews that are not filtered, the study says it’s impossible to know for certain how many are suspect.

Fraudulent reviews are growing as more businesses become aware of the importance of social media and compete with rivals for public affection. “The problem is definitely more widespread than the Attorney General’s investigation,” Luca says. “That’s just one small piece of the puzzle.” A Yelp spokesman says the site is so aggressive in its filtering of suspicious reviews that business owners often complain legitimate praise for their establishments gets yanked from view.

Consumers can also be influenced to see the world through rose-tinted glasses. Of the top reviews on Amazon analyzed in a 2011 study by technology entrepreneur Filip Keeler and Trevor Pinch, a professor at Cornell University’s department of science and technology studies, over 80% were positive. The study, “Free Lunch,” concluded that 85% of the most prolific reviewers are part of “Amazon Vine”— the site’s “most trusted” reviewers — and received free products from publishers, agents and manufacturers. This, Kessler says, can make them unpaid agents rather than consumer advocates. “Consumers should not rely solely on Amazon reviews,” he says.

Yelp deems 20% of user reviews ‘suspicious’

(3:55)

Fraudulent reviews are growing as more businesses become aware of the importance of social media and compete with rivals for public affection. Quentin Fottrell explains on the News Hub.

But in an effort to weed out professional reviewers masquerading as consumers, Google
GOOG, -1.10%
and Yelp gently encourage users to use their real names where possible — and expressly forbid paid reviews. Reviewers are encouraged to build a social network and at least use their first name and last initial, says Vince Sollitto, a Yelp spokesman. “Yelp is a community website not a bulletin board,” he says. Similarly, Google+ allows nicknames, but company policy states that users must provide a two-part name — Jane S. or J. Smith rather than J.S., for example. Sollitto also says that anonymous reviews are essential for sensitive services like plastic surgery. “The marketplace is richer for that opportunity,” he says.

How can consumers tell if a review is not what it appears to be? Consumers should look closely at the source and language of one-star reviews to see if a company could be dissing a rival and pay equally close attention to five-star reviews in case the business itself has decided to award itself the highest praise possible, Luca says. “There is little incentive for a business to leave a mediocre review,” according to “Fake It Till You Make It.” “Hence, the distribution of fake reviews should tend to be more extreme than that of legitimate reviews.” That’s why some sports — like gymnastics — use a “trimmed mean” where the highest and lowest scores are discarded. Ratings for legitimate reviews show a “sharp peak” at four-out-of-five stars, the study found.

In terms of trustworthiness, word-of-mouth from family and friends still trumps online reviews, but the latter is playing catch-up. Only 79% of people say they trust online reviews as much as personal recommendations, up from 72% last year, according to the 2013 “Local Consumer Review Survey” by e-commerce company BrightLocal. “Would Yelp be better off if it required real names?” says consumer advocate Edgar Dworsky. “Probably, but that would require some type of verification mechanism that would likely be very time-consuming and costly.” There is one site where users share opinions with greater transparency than Yelp or Google: Facebook. The world’s biggest social-networking site prohibits the use of fake names.

Intraday Data provided by SIX Financial Information and subject to terms of use.
Historical and current end-of-day data provided by SIX Financial Information. Intraday data
delayed per exchange requirements. S&P/Dow Jones Indices (SM) from Dow Jones & Company, Inc.
All quotes are in local exchange time. Real time last sale data provided by NASDAQ. More
information on NASDAQ traded symbols and their current financial status. Intraday
data delayed 15 minutes for Nasdaq, and 20 minutes for other exchanges. S&P/Dow Jones Indices (SM)
from Dow Jones & Company, Inc. SEHK intraday data is provided by SIX Financial Information and is
at least 60-minutes delayed. All quotes are in local exchange time.