Posts tagged “processing”

[from steve_portigal] Armies of Expensive Lawyers, Replaced by Cheaper Software [HeraldTribune.com] – [Spin in this article is that using computers to manage super-human levels of complex data will have employment consequences.] When five television studios became entangled in a Justice Department antitrust lawsuit against CBS, the cost was immense. As part of the obscure task of “discovery” ­ providing documents relevant to a lawsuit ­ the studios examined six million documents at a cost of more than $2.2 million, much of it to pay for lawyers and paralegals who worked for months. But that was in 1978. Now, thanks to advances in artificial intelligence, “e-discovery” software can analyze documents in a fraction of the time and cost. In January, Blackstone Discovery of Palo Alto, CA., helped analyze 1.5 million documents for less than $100,000. Some programs can extract relevant concepts ­ like documents relevant to social protest in the Middle East ­ even in the absence of specific terms, and deduce patterns of behavior that would have eluded lawyers examining millions of documents.

[from steve_portigal] PG&E launches huge paper chase for pipeline data [SF Chronicle] – [You think you have a lot of data to process? Obviously their record-keeping incompetence is just now being surfaced and they have taken on a data task that is beyond human scale. We can create systems that we can't manage!] For the past couple of days, forklifts have been carting pallets loaded with 30 boxes each into 3 warehouses outside the 70-year-old Cow Palace arena in Daly City. Friday afternoon, there were still more than 100 pallets stacked outside the warehouses waiting to go in. "There are 100,000 boxes in there, and you can't believe the papers spread everywhere," one PG&E employee said …"There are records in there going back to the 1920s. "We're looking at all kinds of parameters, and our data validation efforts are going on throughout the service area,…We're doing a 24-7 records search involving at least 300 employees and contractors, and we're working to confirm the quality of our data through collecting and validating our gas transmission pipeline records."