TDZ: On Bended Knee

Over the summer, the Football Outsiders research staff discovered a statistical trend so revolutionary that it will change the way you think about football.

We stumbled upon this trend by accident, like paleontologists tripping over a stone that turns out to be the skull of some new species of dinosaur. Once unearthed, this trend changed our entire football zeitgeist. It's a powerful, unarguable fact that may alter your viewing or wagering habits. It may even change the way the game is played.

Here's what we discovered: teams that execute two or more "quarterback kneel" plays win 90 percent of the time. Teams that execute one or fewer kneels only win 46 percent of the time. And while winning teams knelt 1.65 times per game from 2000-06, losing teams have averaged just 0.25 kneels per game.*

The data is clear and irrefutable: teams that kneel on the ball win far more often than teams that don't. What's more, the margin of victory correlates closely with the number of kneels: teams that kneel more win far more blowouts, while teams that kneel infrequently are involved in far more tight victories.

There's only one conclusion to be drawn from the data. If you want to win, you have call more kneel plays.

Reflections on Genuflection

Our Kneel to Win theory had the potential to turn the football world on its ear, but at first it was just a rough diamond that needed to be cut and polished. We spent the summer applying state-of-the-art scientific methods to the theory. The results were fascinating.

In games in which the quarterback did not kneel at all, teams average 18.4 points per game. When the quarterback knelt once in a game, teams averaged 20.2 points. In games with two kneels, teams averaged 22.1 points per game. By simple linear regression (a method that relates one variable to another and allows statisticians to extrapolate predictions), it follows that if a team calls 40 quarterback kneels in a game, they will score 92.4 points per game.

Clearly, offensive coordinators are missing the boat with all of their rushing and passing and West Coast Jet Smoke gobbledygook. The data indicates that the easiest way to score in the NFL is not to move the ball at all. Further research proved that the same trend is prevalent at the college and high school levels.

How can teams score more points while kneeling more often? After studying the statistics, we developed several theories. A team that kneels more often is clearly more rested than a team that doesn't, and you can't overestimate the effect of fatigue on football players. It's almost impossible to injure a kneeling quarterback, so teams with a kneel-first philosophy won't have to rely on a backup in a key game (unless the starter gets tendonitis in his kneeling knee). And constant kneeling would allow a team to dictate the tempo of the game while projecting an air of confidence and a winning attitude. Great teams always play with confidence and a winning attitude.

We approached several NFL offensive coordinators about our Kneel to Win theory. We even had some interns devise a "kneel chart," that would show coaches what game situations call for a quarterback kneel. The coordinators were polite, but skeptical. They think of their phonebook-thick playbooks as children, and they are reluctant to part with them. They just couldn't comprehend a truly scientific, visionary approach to their sport. It's a shame, because according to the data, we could be watching football games in which both teams snap the ball and genuflect for 60 minutes, with scores that rival the NBA in the 1980s.

Correlation and Causation

The Kneel to Win theory is pretty stupid, isn't it? Obviously, anyone who thinks that kneel plays lead to victories doesn't realize the difference between correlation (the relationship between two variables) and causation (one variable directly affecting the other).

In the example above, the relationship between the variables is exactly backwards. Kneeling does not cause winning. Winning causes kneeling. Every 10-year-old knows this, and anyone who thinks otherwise needs serious psychological attention.

So we can all chuckle at the Kneel to Win theory. We're all smarter than that. But then, we pick up the local newspaper and read pre-game analysis like this: "The Home Team has to run the ball more often this week. When they run the ball 30 times, they win 90 percent of the time."

Here we go again, folks.

The relationship between running the ball and winning is more complicated than the relationship between kneeling and winning. A good running game certainly contributes to the winning effort. But teams don't win because they run 30 times. Teams run the ball 30 times because they are protecting the lead on their way to a win. It's a fact every thoughtful fan appreciates, and the Run to Win myth was debunked decades before Football Outsiders came into existence. Yet sportstalk hosts and local columnists still trot out the Run to Win theory as if they think that 30 straight handoffs to start the game will guarantee a victory by statistical fiat. That's as silly as thinking that kneeling on the ball is the key to success.

Aaron Schatz founded Football Outsiders three four years ago to combat just this sort of lazy analysis. Boston media pundits consistently hammered the Patriots in 2002 for not running the ball often enough; the team ran far more often in their Super Bowl season than they did during that disappointing 9-7 campaign. Why couldn't they see that they were throwing the ball too often? Aaron ran the numbers and proved that the Patriots run-pass ratio early in games changed little from 2001 to 2002, but in 2001 they ran to protect leads in the second half while in 2002 they passed to catch up. The experts had it backwards. While conducting his research, Aaron laid the groundwork for the statistics that would become DVOA and DPAR, paving the way for him to launch the top independent football research site on the Internet.

Still, the Run to Win theory survives and thrives. It has corollaries, too. There's the He Throws Too Much corollary: Brett Favre isn't that great, because the Packers are 7-15 (or whatever) when he throws over 40 passes per game. Of course, Favre only throws 40 passes when the Packers are already trailing, but never mind. And there's the Good Teams Run and Stop the Run postulate, which extends Run to Win to defense. And there are other nuggets of conventional wisdom, like Good Teams Find a Way to Win Close Games, that have little factual basis but live on in the minds of fans and sportscasters.

Of course, if everybody took a careful, thoughtful, analytical approach to football, Football Outsiders would have a hard time standing apart from the crowd.

Learning is Fundamental

Kneel to Win is a snarky parody of the misuse of statistics. But it's also a cautionary tale. Even the most careful, well-meaning statisticians can screw up. At FO, we like to think that we provide the best analysis on the web. But how do we know that we aren't just advancing pseudoscientific claptrap, Kneel-to-Win silliness embellished with a veneer of mathematical precision?

Numbers can lie, they can mislead, they can obscure, and they can send you on mathematical wild goose chases. Sometimes, there's no way to measure the phenomenon you're trying to study. Sometimes, the statistics you want to use to rate a player's performance -- like tackles for cornerbacks -- are the wrong tool for the job. Because of this, some analysts throw all football stats into the circular file, except the ones that "prove" whatever point they want to make at any given moment. Other observers do the best they can with the numbers that are available, massaging them every which way in a search for underlying truth. That's more or less what we do at Football Outsiders, and we've come up with some mathematical models that rate player and team performance well and, more importantly, do a great job of predicting future performance.

There are other models and systems available, many of them very enlightening and useful, most of them very complex. But just because a statistical model is complicated and scientific-looking doesn't mean it's correct. Just because a writer has a degree in economics or quantum physics doesn't make him right. And just because a conclusion jibes with our gut instincts doesn't mean it's the right conclusion.

DVOA is a great statistical model, but not because it's built on thousands of calculations, or because Aaron is really smart, or because we all just "know" that the best teams must move the ball consistently and convert third downs. It's not a great model because we have a popular website or a deal with FOXSports.com or because Pro Football Prospectus is our ball and we'll take it home if you don't let us play quarterback. DVOA works because it makes excellent predictions, week in and year out, exposing pretender teams with gaudy records and often recognizing rising stars just before they start their ascent. And in 2005, when the Colts played their Sun Belt Conference schedule and the flaws in the DVOA strength-of-schedule adjustments were exposed, we got out the wrenches and fixed the system, making it more accurate not only for the Colts or the 2005 season, but for every team in the past decade.

Any complex statistical model like DVOA is only as sound as the ideas underlying it. And those ideas are only worthwhile if they are grounded in reality. That sounds simple, but it's a fact often forgotten by analysts who make the Run to Win or Kneel to Win mistake: they start believing their tables and graphs and ignoring what really happens when young men walk onto a gridiron.

Accurate statistical analysis of football requires three things. One is a knowledge of statistics. The second is a knowledge of football. You don't need a BA in mathematics and a decade of coaching experience to do stat analysis; if that were the case, Bill Belichick would be the only person in the field. But you need to know what regression analysis is, and you should be able to spot zone coverage or a trap block when watching a replay.

But the third necessity is crucial: the drive to constantly expand your knowledge of the first two factors. A good analyst strives to make himself a better mathematician and a better football guy. He watches more games, reads more books, talks with more coaches and other experts, all the while experimenting with new calculations and testing new hypotheses. Without the drive to improve, an analyst might develop a "good enough" system, then spend the rest of his energy defending it instead of proving it. In effect, he makes a modest gain, then kneels on the ball.

That's something we will never do. The watchword at Football Outsiders is always "improvement:" adding relevant variables to projection systems, revising and retesting DVOA and KUBIAK and our other stats, accumulating more data, interpreting that data, achieving better results and more accurate conclusions, eliminating spelling errors (that last one's the toughest). We strive to improve so our content is better, but we also do it to learn. As long as we keep learning, our analysis, while never perfect, will keep moving forward, steering wide of the Run to Win/Kneel to Win ditch of faulty logic.

The Geeks Who Triple Check

The Football Outsiders are sometimes called the "stat geeks." In Pro Football Prospectus 2006, Aaron counters that we are really "philosophy geeks," guys who look for true team qualities that transcend wins and losses. I would shed the geek label altogether (if only) and suggest that we're simply the guys who triple check. We don't take anything at face value, even our own conclusions. We put conventional wisdom to the test. We record hundreds of games, scrutinize every play, verify every statistic. We learn as much as possible, so when we post a new statistic or power ranking or conclusion, you can be sure it's the result of keen observation, the critical starting point for scientific thought.

So as you watch football this season, be on the lookout for bad stats, backwards stats, stats that are too good to be true, stats that are too complex to be deciphered, stats that miss the forest for the trees, stats built on a foundation of ignorance or wishful thinking, good stats used badly, and bad stats used indiscriminately. Get ready to wince when the announcer says that some lousy team has the third best pass defense in the league (could it be because no one has to throw the ball against them?), that Team X is great because they have great roster stability (maybe there's little turnover because the team wants to keep quality players) or that the home team is 16-0 when Joe Workhorse gets 30 carries. Greet everything with a skeptic's eye, even what you read in Too Deep Zone or at Football Outsiders. We're all learning about football together, and the more we learn, the faster we can replace "conventional wisdom" with actual knowledge.

Comments

But now you have the charting data, and can use real kneeldown stats. What are the actual numbers?

3

by Fnor (not verified) :: Fri, 08/31/2007 - 1:58pm

On the contrary, I think the kneeling offence, when combined with an amazing defence and ROBO-PUNTER, would be a really good strategy. 0 chance of turnovers, and high chance of safeties!

4

by Chris G (not verified) :: Fri, 08/31/2007 - 2:03pm

Just as good the second time.

5

by Zac (not verified) :: Fri, 08/31/2007 - 2:37pm

Aw, man, I just noticed the asterisk. I was going to ask what team lost a game with two or more kneeldowns.

I suppose it could have been someone who kneeled down to end the 1st half.

6

by SG (not verified) :: Fri, 08/31/2007 - 2:56pm

You know, if Travis Henry's girlfriends would have done fewer kneeldowns, perhaps Travis would have more disposable income today.

7

by Jesse (not verified) :: Fri, 08/31/2007 - 3:05pm

Peyton Manning is clearly the better of the two quarterbacks because he puts up better numbers, and he doesn't actually choke in the playoffs, he just plays against better teams.

Whoops, wrong thread. Sorry.

8

by NewsToTom (not verified) :: Fri, 08/31/2007 - 3:16pm

Darn, I actually have work to do this afternoon, or else I'd do the kneeldown stats from 2006. Maybe this weekend.

9

by Stereochemistry (not verified) :: Fri, 08/31/2007 - 3:59pm

Thank you for putting all of this in one place: Bucs fans have had to recently suffer the irrational "When Carnell Williams rushes for 100 yards, the Bucs win" stat for two seasons now: first to show why they were winning in 2005, then to show why they were losing in 2006.

10

by dryheat (not verified) :: Fri, 08/31/2007 - 4:29pm

#6...Don't you have that backwards? If they'd done more kneeldowns....

11

by Chris Heinonen (not verified) :: Fri, 08/31/2007 - 4:43pm

#6,10: Did anyone else read Bill Simmons over at ESPN today and find this line about Travis Henry:

According to the guys at Football Outsiders, Henry has the highest kids-per-partners rate (100.0) since they started keeping track of the stat in 1993.

I think in Cadillac's case, it may be a little more real. After all, it's my impression that his performance has actually varied greatly game-to-game, relating to his health and the quality of the defense he's facing.

I'm not saying that Tampa should use Caddy more, I'm saying that whether Caddy plays well or poorly has a LARGE impact on whether Tampa wins or not. (And playing well is not necessarily measured by 100 yards, although that is a clue).

14

by Reverendum (not verified) :: Fri, 08/31/2007 - 5:47pm

"The data indicates that the easiest way to score in the NFL is not to move the ball at all."

This is crap--kneeling totally moves the ball.

I guess I just can't believe anything these guys say anymore.

1:
THAT's a joke, right?

6 & 10:
Um, aren't you guys making certain pivotal assumptions as to which side Mr. Henry is standing (or, himself, kneeling) on?

15

by Bobman (not verified) :: Fri, 08/31/2007 - 5:52pm

I am way out of the loop on the Travis Henry jokes, but that is some funny excrement.

So now will we hear the wise commentators on TV espousing the virtues of kneeling to win, or is it kneeling to set up the run, or in the Marino/Manning mold, spiking to set up a real pass?

16

by SG (not verified) :: Fri, 08/31/2007 - 10:07pm

#14:

Um, yes, I am making a pivotal assumption. Namely, that a back used to standing behind the line and hitting the 5-hole would do the same off the field.

17

by Alex (not verified) :: Sat, 09/01/2007 - 12:28am

Clever post. But this is an old joke.

Well, it's not too old for virtually everyone in the mainstream media to fall for the "run-to-win" theory. I think anything that brings us closer to the day when we are rid of the "run-to-win" nonsense, and its ilk, is worthwhile.

Good article Tanier. It always makes me laugh when Madden or Joe Buck points out the teams record when they run the ball 30 times, or the back has 100 yards etc.

How about when the SB comes around and the theories about bird mascots vs other animal mascots etc.

19

by andrew (not verified) :: Sat, 09/01/2007 - 1:44pm

If robo-punter punts for pure hang time, he can probably run 20+ Seconds off The clock, Provided he is in an outdoor stadium. And get the ball out of bounds.

20

by miles (not verified) :: Sat, 09/01/2007 - 4:45pm

weâ€™ve come up with some mathematical models that rate player and team performance well and, more importantly, do a great job of predicting future performance." Where is the article showing the great job at predicting future performance? (Or is that the stat we shouldn't question?)

Where is the article showing the great job at predicting future performance? (Or is that the stat we shouldnâ€™t question?)

Go through the archived DVOA reports, and compare weekly DVOA to complete-season performance. There's no specific article for predictions of team-by-team quality because that's what the site does.

24

by jaster (not verified) :: Sun, 09/02/2007 - 5:59am

Re 16:

Oh my god, I almost laughed up a lung.

25

by TomC (not verified) :: Sun, 09/02/2007 - 2:53pm

#6,10: Did anyone else read Bill Simmons over at ESPN today and find this line about Travis Henry: According to the guys at Football Outsiders, Henry has the highest kids-per-partners rate (100.0) since they started keeping track of the stat in 1993.

That joke sums up just how far FO has come in the last few years. An ESPN columnist makes up a funny stat and thinks: "Who should I attribute this to to maximize joke potential?", and not only does he think the answer is FO, but he also assumes that enough of his readers will know what he's talking about. I think that's awesome.

Where is the article showing the great job at predicting future performance?

Well, you can click the link in my name for the FO FAQ, then scroll down to this part for some evidence of the predictive ability of DVOA:

"Q: Does DVOA really work?"

27

by Mr-Steve (not verified) :: Mon, 09/03/2007 - 12:53am

A friend and I were just talking about teams needing to bring back the quick-kick. I can see some high-powered team starting their first series by kneeling fow a couple of downs then running a quick kick.

Now, that's football!

>>>>>>>>>>

28

by JoshuaPerry (not verified) :: Mon, 09/03/2007 - 4:00pm

6 You mean if Travis Henry's women had done more kneel downs, he'd have more disposable income

If DVOA did such a great job of predicting future performance, then why were they 17-15 picking over unders last year? My girlfriend knows nothing about football and could have gone 17-15 picking O/Us.

Vegas is still king.

30

by Alex (not verified) :: Mon, 09/03/2007 - 7:22pm

If DVOA did such a great job of predicting future performance, then why were they 17-15 picking over unders last year?

This is from "METHODS TO OUR MADNESS":

"The biggest advantage of DVOA is the ability to break teams and players down to find strengths and weaknesses in a variety of situations. In the aggregate, DVOA may not be quite as accurate as some of the other, similar "power ratings" formulas based on comparing drives rather than individual plays, but, unlike those other ratings, DVOA can be separated not only by player but also by down, or by week, or by distance needed for first down. This can give us a better idea of not just which team is better but why, and what a team has to do in order to improve itself in the future."

Does Vegas give O/Us on how good the Redskins are going to be on third down next year? Not that I've ever heard of. So there's no way to test DVOA against Vegas in DVOA's strongest category because Vegas doesn't even try to make predictions about such things.

31

by Bill Barnwell :: Mon, 09/03/2007 - 7:31pm

If DVOA did such a great job of predicting future performance, then why were they 17-15 picking over unders last year? My girlfriend knows nothing about football and could have gone 17-15 picking O/Us.

Vegas is still king.

A) That was me who went 17-15, not the projection system. You'll need to get your facts right if you're going to start formulating arguments.

B) I strongly doubt your "girlfriend" (this is the internet, after all) would go 17-15 against the O/U spread.

C) You might notice how similar our projections tend to be compared to Vegas' each year. Last year, the biggest outlier with our system as opposed to Vegas was San Diego, which crushed Vegas in our favor.

32

by LnGrrrR (not verified) :: Tue, 09/04/2007 - 1:09am

I'm sad that we won't see anymore of the "Tampa can't win in 32 degrees or less weather!" stat. I loved that one.

33

by Andrew (not verified) :: Tue, 09/04/2007 - 1:21pm

Fnor #3:

0 chance of turnovers

Botched snaps on the kneel down plays and punts could both occur. Plus, don't put it past the players to pull a Pisarcik.

34

by Sid (not verified) :: Thu, 09/06/2007 - 8:17pm

it never stops. On ESPN Radio, this idiot just argued that the Giants are in good shape with Brandon Jacobs because they were 3-0 when he got 10 touches in a game last season.