“We all now rely heavily on websites like Yelp and TripAdvisor in our personal lives -- these sites feature trusted reviews to help us make quick, easy purchase decisions," said Tom Gorski, cofounder and CEO at the firm. "Even employees in large companies now expect a more customer-like online research and buying experience.”

Once the site launches in full, beta users will get an extended free trial, the company says.

"The next three or four months are all about us getting more data," Gorski said. "We're going to optimize our site, we're going to see how people are using it, and we're going to test if there is a way of monetizing it."

SaasGenius isn't the first company to try to bring user reviews to the world of enterprise software. Ombud is another example, and Rob Enderle, principal analyst with Enderle Group, is on its advisory board.

"The issue is that it is really hard to get accurate reviews, between shills, competitors and folks that have never touched the product, and you tend to get too much false information," Enderle said. "Even if you get an accurate review, this class of product requires a lot of support and integration, which means the reviewer's experience likely will not match your own."

Such review sites face significant hurdles when it comes to large enterprise solutions such as SAP, Oracle’s E-Business Suite or Salesforce.com, agreed analyst Frank Scavo, president of Computer Economics.

"First, these review sites are easily gamed," Scavo said.

It's easy to post fake reviews, in other words, either in favor of a vendor or against it, he explained. "These sites try to weed out obviously false reviews, but there’s not much they can do to stop a vendor from stuffing the ballot box."

It's also important to compare any system against your own business requirements, Scavo said: "No two vendors are the same. A system that works well for one company may not work well for another."

Finally, bad experiences aren't always the fault of the vendor.

"Plenty of business software projects have gone south because of failures on the client side or on the side of the system integrator," he said. "But you’ll seldom hear a reviewer blame himself for the problem."

So what should a buyer do?

"There’s no substitute for good old-fashioned reference checking," Scavo said. "Find other users of the software and talk to them. Ask them what they like, what they don’t like. Ask them what they would do differently. Ask them how they would advise you if you go forward with a certain vendor."

It's common to neglect that step, but "in my experience, there is no better way to do your due diligence," he added.

Katherine Noyes has been an ardent geek ever since she first conquered Pyramid of Doom on an ancient TRS-80. Today she covers enterprise software in all its forms, with an emphasis on cloud computing, big data, analytics and artificial intelligence.