Academic Performance and the BCS

Nothing captures our national enthusiasm for sports more than rankings.

We love them, consume them, argue about them, reject them, and embrace them. The industry of sports ranking keeps many print publication alive, and serves to inform tailgate celebrations throughout the college sports season with the illusion of substantive, scientific calibration of our sports enthusiasm. Among the many rankings, we of course have the BCS system that generates a list of what are presumably the best football teams in America, using methodologies praised by those whose teams score high and attacked by those whose teams fail to make the cut.

Those of us who inhabit the core of the university’s academic environment share the enthusiasm for measuring and evaluating the quality of our institutions, although we have less enthusiasm for the endless ranked lists that appear in popular publications.

While some dote on the U.S. News rankings, which like their BCS counterpart rely on hugely unreliable opinion surveys, we, however, prefer our own system for evaluating the Top American Research Universities that recognizes the importance of successful performance among highly competitive institutions without requiring a simple top to bottom ranking that often distorts more than it informs.

For over ten years, The Center for Measuring University Performance[1], now located at Arizona State University, has produced an annual report on the Top American Research Universities that uses objective data on nine measures to put universities into categories according to their performance.

We measure research, of course, by the amount of research expenditures of each university in two categories: Total Research that includes all sources, and Federal Research that includes the peer reviewed research activities sponsored by the Federal government. In addition we collect information on Endowment, Annual Giving, National Academy Membership, Faculty Awards, Doctoral degrees awarded, Postdoctoral Fellowships supported, and average SAT scores of entering students. For a full discussion of all these measures, see the most recent edition of The Top American Research Universities[2] (2010) available online.

Our interest in intercollegiate athletics is long-standing as college sports form such a significant element in so many prominent and successful research universities, and we published a discussion of that phenomenon some years ago in The Sports Imperative in America’s Research Universities[3] (2003) available online.

Given the recent attention to conferences and possible conference realignments, as well as national media attention to the academic quality of the universities in each conference, we thought it might be interesting to use our data to construct an index to the academic distinction of the universities in the six major BCS conferences. In our annual report, we group universities into clusters based on their performance among the top 25 or the second 25 on our measures.

A university that is in the top 25 on all nine of our measures, scores a 9 while a university that is in the second category falling between 26 and 50 in national rank would earn a 4.5. Some institutions fall into the top 25 on some measures and the second 25 on others. If they have six measures in the top 25 and three measures in the second 25, we would assign them an academic distinction score of 6 plus 1.5 or 7.5.

By combining these indexes of academic performance for the members of the conferences, we can produce a reliable indicator of the combined academic distinction of the institutions in each of the six BCS conferences.

It will come as no real surprise to those who watch our academic landscape to discover that the Big 10 leads the field with an academic distinction index of 55, followed closely by the Pac-12 with 48. The ACC falls some distance behind with an index of 28.5 and the SEC a significant distance away at 14, followed closely by the Big-Twelve and the Big East at 12.

As a reference, we also constructed an index for the Ivy League, to put all this into perspective. This premier academic conference would fall into second place, after the Big-10 and before the Pac-12.

Although the decisions about conference alignments and realignments turn primarily on issues of television, audiences, institutional athletic comparability, and of course money, the quality of an institution’s athletic conference is one of the elements that helps universities create and sustain a reputation for high quality, much prized by prospective students and alumni.

As these data show, high powered academics and high powered athletics coexist in many first rank institutions. However, we also conclude that having a first rate athletic program is no guarantee of high-powered academics but that many first-rate research universities have no difficulty sustaining outstanding athletic programs.

The following table provides the summary data for each conference. (Note: This article has been updated to correct an error.)

***

Author/s:

John V. Lombardi and Elizabeth D. Capaldi

Author's email:

info@insidehighered.com

John V. Lombardi is president of Louisiana State University, Elizabeth D. Capaldi is university provost and executive vice president at Arizona State University, and Craig W. Abbey is senior assistant vice president for institutional analysis at the State University of New York at Buffalo.