TPC Benchmark StatusJune 2012

Overview

Published about 4 times per year, the TPC Benchmark Status Report is a digest of the activities of the TPC and its technical subcommittees.

The TPC held meetings on February 10th in Houston, TX and on April 13th in Colorado Springs. CO. The TPC-DS specification was approved as a benchmark standard. The TPC-Energy specification is now on version 1.5.0, including additions for the TPC-DS standard, as well as code enhancements to the EMSC to incorporate the new SPEC PTDaemon version. The TPC’s fourth Technology Conference, TPCTC 2012, will be held on Monday August 28th, 2011 in conjunction with the annual conference on Very Large Databases (VLDB), in Istanbul, Turkey.

Current Benchmarks

TPC-C

The TPC-C Maintenance Subcommittee had no outstanding issues to discuss at the April 2012 meeting. The subcommittee will continue to monitor the benchmark, along with any TAB interpretations and rulings, for discussion and possible inclusion in future versions of the TPC-C specification.

TPC-DS

The TPC-DS specification was approved and became a benchmark standard in January, 2012. Since then, the subcommittee released Version 1.1.0 of the TPC-DS specification, which clarifies that trickle updates are mandatory.

TPC-E

The TPC-E Maintenance Subcommittee has made some minor enhancements to the EGen code to improve platform support, and is reviewing and extending the development of the unit test framework for EGen.

TPC-H

The TPC-H subcommittee released Version 2.14.4 of the TPC-H specification, which corrects an error in the definition of L_RECEIPTDATE.

Benchmarks Under Development

TPC-V

The TPC-V development subcommittee has been making progress in developing an end-to-end reference benchmarking kit, which is now functional and executes most TPC-V transactions with a multi-threaded driver

TPC-VMS

TPC-VMS specifies the rules and methodology for measuring and reporting TPC-C, TPC-E, TPC-H and TPC-DS metrics running in a Virtualized Environment.

The TPC-VMS Benchmark Specification has moved to Formal Review.

Specifications Common to All Benchmarks

TPC-Energy

The TPC Energy subcommittee updated the EMSC code to version 1.5.0 which incorporates the new SPEC PTDaemon Version 1.4.1. The TPC-Energy specification is revision 1.50 and includes additions for the TPC-DS Benchmark Standard.

Pricing Specification

The current TPC Price Specification is Version 1.7.0 which includes minor enhancements to recognize use of storage devices other than rotating disks and to recognize that pricing rules apply to results that are in an active state on the TPC results list. All prior active results are considered to be comparable to those published under revision 1.7.

Other TPC Activities

TPC Technology Conference 2012

The TPC announced its participation in TPCTC 2012 in conjunction with VLDB2012 in Istanbul, Turkey, and issued a call for papers for the workshop which will be held on August 28, 2011. With this conference, the third in the series, the TPC encourages researchers and industry experts to submit novel ideas and methodologies in performance evaluation, measurement, and characterization. Topics of interest include, but are not limited to