Seeding Errors

The next post shows the effect of different methods of seeding a tourney like the upcoming Western and Southern Open tennis tournament. But the experiment assumed that the seeding perfectly reflected the actual skill of the various players.

We know that this is not what happens in real life. The ATP points on which seeding is based do tend to correlate with skill – the whole seeding regime would be pretty pointless if they did not. But that’s not all that the ATP is trying to accomplish with their points. ATP points are not just a reflection of skill, but a reward for playing.

Certain players of undoubted skill, especially those who have missed a lot of recent tournaments, have relatively few ATP points, and thus relatively low rankings. Andy Murray has been away from the tour so long that he needed a special “wild card” exemption to even make the W&S field. Like Murray, Novak Djokovic has also been recovering from injury, and will also enter the W&S unseeded.

How much does this gap between a player’s seeding based on ATP points and his or her actual skill affect prospects for success? Some effects are dramatic – as I’ll show below, Novak’s low seeding will cost him, on average, over $100,000.

Here are the sixteen best players currently scheduled to play in the W&S as judged by the average odds that are offered on their chance to win the U.S. Open, along with their seeding rank, and what that means for their actual seeding in the W&S. At the bottom of the list, I’ve added those players who will be seeded, but were not among the top 16 according to the betting odds,

skill

ATP

seeding

1

Novak Djokovic

10

tier 5

2

Roger Federer

2

tier 2

3

Rafael Nadal

1

tier 1

4

Alexander Zverev

3

tier 3

5

Juan Martin del Potro

4

tier 3

6

Andy Murray

49

unseeded

7

Marin Cilic

7

tier 4

8

Nick Kyrgios

17

unseeded

9

Stan Wawrinka

48

unseeded

10

Kei Nishikori

22

unseeded

11

Milos Ronic

29

unseeded

12

Kevin Anderson

6

tier 4

13

Grigor Dimitrov

5

tier 4

14

Dominic Thiem

8

tier 4

15

Denis Shapovalov

26

unseeded

16

John Isner

9

tier 5

18

David Goffin

11

tier 5

33

Diego Schwartzman

12

tier 5

27

Pablo Carreno Busta

13

tier 6

29

Fabio Fognini

14

tier 6

25

Roberto Bautista Agut

15

tier 6

22

Kyle Edmund

16

tier 6

This table shows the expectation of each of these men, first as if they had been seeded according to the betting odds, then with their actual seeding, and the difference:

Novak Djokovic

$ 538,475

$ 445,275

$ (93,201)

Roger Federer

$ 374,739

$ 364,893

$ (9,846)

Rafael Nadal

$ 282,916

$ 294,638

$ 11,722

Alexander Zverev

$ 244,445

$ 243,821

$ (624)

Juan Martin del Potro

$ 191,575

$ 216,849

$ 25,275

Andy Murray

$ 173,759

$ 117,196

$ (56,563)

Marin Cilic

$ 159,713

$ 154,982

$ (4,731)

Nick Kyrgios

$ 148,542

$ 96,133

$ (52,409)

Stan Wawrinka

$ 99,582

$ 88,962

$ (10,620)

Kei Nishikori

$ 93,288

$ 82,876

$ (10,412)

Milos Ronic

$ 87,427

$ 77,749

$ (9,678)

Kevin Anderson

$ 83,174

$ 114,426

$ 31,251

Grigor Dimitrov

$ 73,440

$ 109,169

$ 35,729

Dominic Thiem

$ 70,458

$ 104,859

$ 34,401

Denis Shapovalov

$ 67,485

$ 63,810

$ (3,675)

John Isner

$ 65,054

$ 71,707

$ 6,654

David Goffin

$ 53,223

$ 66,046

$ 12,823

Diego Schwartzman

$ 38,233

$ 46,576

$ 8,343

Pablo Carreno Busta

$ 43,074

$ 48,070

$ 4,996

Fabio Fognini

$ 41,682

$ 46,639

$ 4,957

Roberto Bautista Agut

$ 44,894

$ 50,337

$ 5,443

Kyle Edmund

$ 47,793

$ 54,035

$ 6,242

The chief victims of the seeding regime are Djokovic, Murray, and Kyrgios, all of whom would have qualified for a top-8 seeding (and thus a bye) if seeded according to the punters’ assessment of their skill. The largest beneficiaries are the players in the top 8 who get byes that they wouldn’t otherwise qualify for: Thiem, Dimitrov, and Anderson. Also getting some benefit are the players at the bottom of the list who got seeds that the skill list would not have given them.

Bear in mind that this are the average expectations from 500,000 trials, each of which had its own draw. The expectations for any particular draw will be quite different.

If, for example, Murray and Djokovic are drawn to play each other in the first round (a 2.5% chance), both of their expectations will suffer considerably because we know that one or the other will have to settle for first-round money. And in all likelihood, Djokovic’s position will be strongly negative for either Nadal or Federer, depending on which half of the draw he lands in.

Once the actual draw takes place (and any late scratches are announced), I’ll run another simulation on the actual draw so that the effects can be assessed.