Author Nicolas Economou, H5’s CEO, sets forth a mathematical equation for assessing document review error. Though the equation is conceptual for now, he also presents provocative empirical data. A study found that the H5 automated approach correctly identified relevant documents 98% of the time.

Of course, many lawyers will immediately react that this is simply unacceptable – how can we live with a 2% error rate. Those lawyers, however, most likely lack empirical data about the accuracy of their army of lawyers.

The article also reports that “for each relevant document missed by the H5 system, the control review process missed 32 documents. That is, the risk of failing to flag relevant documents for litigator review was 32 times greater under the traditional review process.”

If this is true and can be further substantiated, at what point will lawyers commit malpractice by continuing to rely primarily on human review?