Did The Packers Squander Aaron Rodgers?

Aaron Rodgers has played every season except his rookie year under Mike McCarthy.

Jonathan Newton / The Washington Post via Getty Images

The dismissal of Green Bay coach Mike McCarthy — who was let go after the Packers’ stunning home loss to the Arizona Cardinals on Sunday — wasn’t exactly a shock. Perennially tabbed as a Super Bowl contender out of the NFC, McCarthy’s team had gone just 11-16-1 over the past two seasons, including a disappointing 8-9-1 in games that featured future Hall of Fame quarterback Aaron Rodgers as Green Bay’s primary passer.1 It was time for a change along the sidelines that Vince Lombardi once roamed.

Things weren’t always so bleak on the frozen tundra. The McCarthy era had its high points, particularly early on — when he and Rodgers appeared to have Green Bay positioned on the cusp of a potential dynasty. But between postseason near-misses, roster changes, injuries and coaching miscues, McCarthy’s Packers never fulfilled that promise. Instead, it’s fair to wonder whether Green Bay squandered the prime of one of the most talented QBs in NFL history.

The Packers team that McCarthy inherited in 2006 from Mike Sherman2 was one in transition — and that meant navigating some heavy-duty Brett Favre melodrama in his first two seasons at Green Bay’s helm. However, McCarthy quickly found that he had an all-time great on his hands in Rodgers, who, when he took over the starting job at age 25, was just entering his best years as a passer. The McCarthy-Rodgers marriage sputtered to a 6-10 finish in its first season but yielded great results shortly thereafter: an 11-5 playoff campaign in Year 2, then a Super Bowl crown in Year 3 and a 15-1 regular season (with Rodgers winning MVP) in Year 4. The sky seemed to be the limit for McCarthy and his star QB.

Since the end of the 2011 regular season, however, the Packers have gone just 5-6 in the playoffs; by comparison, Tom Brady and the postseason Patriots are 13-5 over the same span. Green Bay’s record includes a crushing home defeat against the New York Giants two weeks after that 15-1 season ended and another loss in which they watched helplessly as ex-49er Colin Kaepernick destroyed their defense in 2012 — still one of the greatest individual QB games in playoff history. The Packers’ postseason circumstances have not always been ideal: For instance, that Giants game was actually the only time since 2011 that Green Bay lost in the playoffs while favored — meaning the rest of the losses were as underdogs. But at the same time, the Pack have also had clear chances to return to the Super Bowl, and they came up short in each of them.

All told, it remains mystifying that a quarterback of Rodgers’s stature hasn’t won more frequently. If we run a simple logit regression between a QB’s Yards Above Backup in a season and whether his team made the Super Bowl,3 we’d expect Rodgers to have made 1.86 Super Bowls in his career through 2017 — roughly twice as many as he’s actually been to. (Meanwhile, other contemporary QBs — such as Ben Roethlisberger, Eli Manning and even Brady — have gone to more than twice as many Super Bowls as we’d expect from their individual stats.)

1990 was the first season of the NFL’s current playoff format. Expected Super Bowls are based on a season-by-season logit regression between a QB’s Yards Above Backup and whether his team made the Super Bowl.

Source: Pro-Football-Reference.com

Over time, it became more and more difficult for the Packers to come within striking distance of the Super Bowl. In 2015, Rodgers slumped to career-worst numbers without top wideout Jordy Nelson, though the team as a whole was still good enough to get to the divisional playoffs before losing. In 2016, it was more of the same when Rodgers mused that Green Bay could still “run the table” — sparking an eight-game winning streak that saw the QB return to vintage form and left the Packers a win away from the Super Bowl.4 By then Rodgers was 34 years old, so a sense of urgency was setting in when 2017 came and went without a playoff berth — even though that could be written off as the byproduct of Rodgers missing nine starts.

The 2018 season was always going to be the real crossroads for McCarthy. With a healthy Rodgers leading the way, the Pack could always count on contending in the past, so this year’s expectations were no different. But Rodgers’s numbers have been merely good, not great. Brett Hundley isn’t around anymore to take any blame. And unlike in 2015, when Green Bay was talented enough to survive despite a downturn in its QB’s individual stats, there has been no answer from the team’s supporting cast this time around. It all came crashing down around McCarthy in the loss to Arizona as 13½-point favorites, Green Bay’s single most disappointing defeat since the merger according to Pro-Football-Reference’s point-spread data.

We can visualize the Packers’ decline over McCarthy’s final few years at the helm using FiveThirtyEight’s Elo ratings. Specifically, I’ve been tinkering with an experimental version of Elo that keeps a separate adjustment for the primary QB in each game, similar to how we treat starting pitchers in our MLB ratings.5 Using this, we can trace how a team’s performance rises and falls independent of its QB — which is useful in cases like 2017, when Rodgers was hurt and Hundley started nine games. (For instance, by season’s end, the Packers would have projected to be a 1529 Elo team with Rodgers starting — compared to a 1427 team with Hundley. And remember, 1500 is average.)

At the beginning of 2015, the Packers had an effective Elo of 1622, which included a 73-point boost from having Rodgers at QB and a 49-point boost from his teammates. By the end of the year, Green Bay’s effective Elo was still in the same neighborhood (1597), despite Rodgers’s adjustment actually dropping to negative 11, because the rest of the team carried a larger share of the weight (+108). Meanwhile, at the peak of the Packers’ run-the-table surge in 2016, the team’s 1657 effective Elo arose out of a 61-point boost from Rodgers and 97 additional points (relative to league average) from the rest of the team.

But fast-forward to now, and it’s clear how much the Packers have crumbled around Rodgers. His own adjustment is 16 points of Elo above an average QB, the lowest it’s been since Week 10 of the 2016 season. But he’s still expected to be above average; his supporting cast, by contrast, has fallen to a negative-67 score relative to the average team. That’s the worst they have been in Rodgers’s entire NFL career, and it isn’t especially close. Keeping QB play constant, the Packers’ Elo has dropped by a total of 139 points since the end of the 2016 season, which is essentially the difference in current Elo ratings of the 11-1 Los Angeles Rams and the 6-6 Carolina Panthers.

Even so, it came contrary to preseason predictions. Going into the schedule, you might have penciled in this week’s matchup against the Atlanta Falcons as a marquee game with playoff implications. Instead, it will be the third-worst game of the week, according to our combination of matchup quality (i.e., the harmonic mean of the teams’ Elo ratings in each game) and game importance (how likely it is to swing every team’s odds of making the playoffs):7

The best matchups of Week 14

Week 14 games by the highest average Elo rating (using the harmonic mean) plus the total potential swing for all NFL teams’ playoff chances based on the result, according to FiveThirtyEight’s NFL predictions

Playoff %

Playoff %

Team A

Current

Avg. Chg*

Team B

Current

Avg. Chg*

Total Change

Game Quality

BAL

65.0%

+/-15.1

KC

100.0%

+/-0.0

31.8

1628

PHI

28.3

24.2

DAL

81.1

19.4

51.0

1578

MIN

59.7

19.9

SEA

87.7

11.8

41.4

1572

CHI

94.4

4.3

LAR

100.0

0.0

10.8

1615

IND

9.8

10.1

HOU

98.2

2.4

23.6

1515

MIA

6.6

7.4

NE

99.7

0.5

16.2

1537

WSH

26.4

11.7

NYG

0.1

0.1

24.9

1435

TB

1.7

2.0

NO

100.0

0.0

6.9

1570

TEN

18.9

10.6

JAX

0.1

0.1

21.9

1478

PIT

83.8

11.0

OAK

0.0

0.0

23.7

1453

CAR

17.8

9.9

CLE

0.3

0.4

22.0

1454

DEN

20.9

11.1

SF

0.0

0.0

24.7

1427

LAC

96.0

3.6

CIN

0.9

1.3

9.1

1504

GB

1.4

1.3

ATL

1.1

1.2

5.5

1469

DET

0.3

0.3

ARI

0.0

0.0

4.2

1412

BUF

0.0

0.0

NYJ

0.0

0.0

2.4

1377

Game quality is the harmonic mean of the Elo ratings for the two teams in a given matchup. Total Change adds up the potential swing in playoff odds for every team in the league (not just the two teams listed).

*Average change is weighted by the likelihood of a win or loss. (Ties are excluded.)

Source: ESPN.com

Although the Packers hadn’t replaced a coach at midseason since 1953, Sunday’s loss forced their hand. Now they’ll need to figure out who’s next, from a candidate list that includes big names among both pro coordinators (Josh McDaniels) and up-and-coming college coaches (Lincoln Riley). They’ll also need to hope Rodgers’s issues were more related to McCarthy’s offense and less to his getting older and less productive — basically, that the next Packer coach will be more Mike Shanahan to Rodgers’s John Elway than Jimmy Johnson to his Dan Marino. So while the Packers may not have much on the line over the rest of their games, this promises to be the most interesting offseason Green Bay has had since Favre was retiring and unretiring more than a decade ago.

Here are the games in which Elo made its best — and worst — predictions against the reader picks last week:

Elo’s dumbest (and smartest) picks of Week 13

Average difference between points won by readers and by Elo in Week 13 matchups in FiveThirtyEight’s NFL prediction game

OUR PREDICTION (ELO)

READERS’ PREDICTION

PICK

WIN PROB.

PICK

WIN PROB.

Result

READERS’ NET PTS

CIN

52%

DEN

59%

DEN 24, CIN 10

+8.5

–

PIT

62

PIT

54

LAC 33, PIT 30

+6.7

–

LAR

68

LAR

79

LAR 30, DET 16

+4.1

–

ATL

53

ATL

50

BAL 26, ATL 16

+1.5

–

KC

83

KC

89

KC 40, OAK 33

+0.4

–

SEA

83

SEA

83

SEA 43, SF 16

-1.5

–

MIA

58

MIA

57

MIA 21, BUF 17

-2.3

–

NE

67

NE

65

NE 24, MIN 10

-3.8

–

PHI

69

PHI

66

PHI 28, WSH 13

-4.1

–

TEN

78

TEN

72

TEN 26, NYJ 22

-4.4

–

CHI

69

CHI

72

NYG 30, CHI 27

-6.1

–

HOU

77

HOU

69

HOU 29, CLE 13

-6.6

–

CAR

59

CAR

64

TB 24, CAR 17

-7.8

–

GB

73

GB

79

ARI 20, GB 17

-10.5

–

IND

51

IND

62

JAX 6, IND 0

-14.0

–

NO

64

NO

74

DAL 13, NO 10

-15.3

–

Home teams are in bold.

The scoring system is nonlinear, so readers’ average points don’t necessarily match the number of points that would be given to the average reader prediction.

After a series of narrow wins at midseason, the algorithm handed the readers their worst loss (-55.2 points on average) since Week 3. Some of the blame can go to the subject of this column — the Green Bay Packers, whose loss not only cost Mike McCarthy his job but also cost users 10.5 points on average. But readers were also burned by the Jaguars’ win over the Colts and the Cowboys’ upset victory over the Saints. Add it up, and Elo has beaten the average reader 12 times in 13 weeks this season.

But congrats to Mike Edelstein, who led all users in Week 13 with 137.0 points, and to one of my favorite leaderboard names, Greg Chili Van Hollebeke, who maintained his No. 1 ranking on the season with 1,002.1 points. Thanks to everyone who has been playing — and if you haven’t, be sure to get in on the action! You can make picks now and still try your luck against Elo, even if you haven’t played yet.

Footnotes

Minimum six starts during the season, using data since 1990 (the era of the current playoff setup).

Though their defense was shredded by Matt Ryan and the Falcons for 493 yards, ending the streak.

For those curious, it uses what I’m calling a QB’s Performance Value Added (PVA). That metric starts with an estimate of a primary QB’s value over replacement (according to ESPN’s expected-points data) in a game:

It then compares that number to the per-game average allowed by the opposing defense in all other games that season (excluding the game in question). By definition, an average PVA is 0.0. Then a running mean of PVA is kept for both teams and individual QBs, which is used to modify the team’s base rating depending on which QB is used. (Interestingly, the predictions work best when the individual ratings update slightly faster than the team ones, which suggest QB “hot streaks” do contain extra information.) Debut QBs are assigned an expected PVA of -47, and they reduce a team’s effective Elo rating by 108 points relative to an average QB.

In addition to the lack of starters from recent drafts, only two of the team’s current starters were drafted by a team other than Green Bay. Again, this was the byproduct of the Packers’ religious devotion to drafting and developing their own prospects, but that plan only really works when you draft well.

A little note is in order here, to explain how these game importance ratings are now calculated. All season long, I have been crunching the numbers on how a given game affects the two teams involved. But this week, with the playoffs on the horizon and certain matchups taking on more importance because of their outside implications, I changed the formula to add up a game’s potential swing in playoff odds for every team in the league — including those not participating in the game itself.