urn:lsid:ibm.com:blogs:entries-eff9becc-b1a3-4cb8-bfb2-619b2a0bfc2eInside System Storage -- by Tony Pearson - Tags - cmu Inside System Storage -- by Tony Pearson03012015-05-28T23:52:22-04:00IBM Connections - Blogsurn:lsid:ibm.com:blogs:entry-1a211658-1ba9-429a-8908-41f83021a5f4Watson: What is the Smartest Machine on Earth?TonyPearson120000HQFFactivefalseComment EntriesLikestrue2011-02-09T12:00:02-05:002011-02-10T12:38:44-05:00<p>
Tonight PBS plans to air Season 38, Episode 6 of NOVA, titled [<a href="http://tv.azpm.org/schedules/episode/40799/">Smartest Machine On Earth</a>]. Here is an excerpt from the station listing:
</p>
<blockquote>
&quot;What's so special about human intelligence and will scientists ever build a computer that rivals the flexibility and power of a human brain? In &quot;Artificial Intelligence,&quot; NOVA takes viewers inside an IBM lab where a crack team has been working for nearly three years to perfect a machine that can answer any question. The scientists hope their machine will be able to beat expert contestants in one of the USA's most challenging TV quiz shows -- Jeopardy, which has entertained viewers for over four decades. &quot;Artificial Intelligence&quot; presents the exclusive inside story of how the IBM team developed the world's smartest computer from scratch. Now they're racing to finish it for a special Jeopardy airdate in February 2011. They've built an exact replica of the studio at its research lab near New York and invited past champions to compete against the machine, a big black box code -- named Watson after IBM's founder, Thomas J. Watson. But will Watson be able to beat out its human competition?&quot;
</blockquote>
<p>
Craig Rhinehart offers
[<a href="http://craigrhinehart.wordpress.com/2011/01/17/10-things-you-need-to-know-about-the-technology-behind-watson/?S_CMP=swnews_twitter">10 Things You Need to Know About the Technology Behind Watson</a>].
</p>
<p>
An artist has come up with this clever
[<a href="http://www.etsy.com/listing/65993473/ibmjeopardy-challenge-commemorative">unofficial poster</a>].
</p>
<p>
Dr. Jon Lenchner from IBM Research has a series of posts on
[<a href="http://ibmresearchnews.blogspot.com/2010/12/how-watson-sees-hears-and-speaks-to.html">How Watson &quot;sees&quot;, &quot;hears&quot;, and &quot;speaks&quot;</a>] and [<a href="http://ibmresearchnews.blogspot.com/2011/02/knowing-what-it-knows-selected-nuances.html">Selected Nuances</a>].
</p>
<p>
Like most supercomputers, Watson runs the Linux operating system. The system runs 2,880 cores (90 IBM Power 750 servers, four sockets each, eight cores per socket) to achieve 80 [<a href="http://kb.iu.edu/data/apeq.html">TeraFlops</a>]. TeraFlops is the unit of measure for supercomputers, representing a trillion floating point operations. By comparison, Hans Morvec, principal research scientist at the Robotics Institute of Carnegie Mellon University (CMU) estimates that the [<a href="http://www.wired.com/techbiz/it/news/2002/11/56459">human brain is about 100 TeraFlops</a>]. So, in the three seconds that Watson gets to calculate its response, it would have processed 240 trillion operations.
</p>
<p>
Several readers of my blog have asked for details on the storage aspects of Watson. Basically, it is a modified version of IBM Scale-Out NAS [<a href="http://www-03.ibm.com/systems/storage/network/sonas/">SONAS</a>] that IBM offers commercially, but running Linux on POWER instead of Linux-x86. System p expansion drawers of SAS 15K RPM 450GB drives, 12 drives each, are dual-connected to two storage nodes, for a total of 21.6TB of raw disk capacity. The storage nodes use IBM's General Parallel File System (GPFS) to provide clustered NFS access to the rest of the system. Each Power 750 has minimal internal storage mostly to hold the Linux operating system and programs.
</p>
<p>
When Watson is booted up, the 15TB of total RAM are loaded up, and thereafter the DeepQA processing is all done from memory. According to IBM Research, &quot;The actual size of the data (analyzed and indexed text, knowledge bases, etc.) used for candidate answer generation and evidence evaluation is under 1TB.&quot; For performance reasons, various subsets of the data are replicated in RAM on different functional groups of cluster nodes. The entire system is self-contained, Watson is <u>NOT</u> going to the internet searching for answers.
</p>
<p>
On ZDnet, Steven J. Vaughan-Nichols welcomes our new [<a href="http://www.zdnet.com/blog/open-source/i-for-one-welcome-our-linux-penguin-jeopardy-overlords/8081">Linux Penguin Jeopardy overlords</a>]. I have to say I share his enthusiasm!
</p>
<p><img src="http://www.ibm.com/developerworks/blogs/resources/InsideSystemStorage/technorati.gif" /><b>technorati tags:</b> <a href="http://www.technorati.com/tags/IBM" rel="tag">IBM</a>, <a href="http://www.technorati.com/tags/Nova" rel="tag">Nova</a>, <a href="http://www.technorati.com/tags/Watson" rel="tag">Watson</a>, <a href="http://www.technorati.com/tags/#ibmwatson" rel="tag">#ibmwatson</a>, <a href="http://www.technorati.com/tags/Jeopardy" rel="tag">Jeopardy</a>, <a href="http://www.technorati.com/tags/POWER7" rel="tag">POWER7</a>, <a href="http://www.technorati.com/tags/p750" rel="tag">p750</a>, <a href="http://www.technorati.com/tags/supercomputer" rel="tag">supercomputer</a>, <a href="http://www.technorati.com/tags/TeraFlops" rel="tag">TeraFlops</a>, <a href="http://www.technorati.com/tags/disk" rel="tag">disk</a>, <a href="http://www.technorati.com/tags/SONAS" rel="tag">SONAS</a>, <a href="http://www.technorati.com/tags/GPFS" rel="tag">GPFS</a>, <a href="http://www.technorati.com/tags/SAS" rel="tag">SAS</a>, <a href="http://www.technorati.com/tags/Craig+Rhinehart" rel="tag">Craig Rhinehart</a>, <a href="http://www.technorati.com/tags/Jon+Lenchner" rel="tag">Jon Lenchner</a>, <a href="http://www.technorati.com/tags/Hans+Morvec" rel="tag">Hans Morvec</a>, <a href="http://www.technorati.com/tags/Carnegie+Mellon+University" rel="tag">Carnegie Mellon University</a>, <a href="http://www.technorati.com/tags/CMU" rel="tag">CMU</a></p>
Tonight PBS plans to air Season 38, Episode 6 of NOVA, titled [ Smartest Machine On Earth ]. Here is an excerpt from the station listing:
&quot;What's so special about human intelligence and will scientists ever build a computer that rivals the flexibility...2511909urn:lsid:ibm.com:blogs:entries-eff9becc-b1a3-4cb8-bfb2-619b2a0bfc2eInside System Storage -- by Tony Pearson2015-05-28T23:52:22-04:00