This article goes into the motivation and architecture for DTrace -- and describes some of the problems that remain to be solved in system observability. The article also includes a short case-study on using DTrace to find a real problem -- a problem that was ultimately due to some seriously fugly code in a monitoring app.