tag:blogger.com,1999:blog-162662562014-10-04T21:27:26.995-05:00Political ArithmetikWhere numbers and politics meet.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comBlogger434125tag:blogger.com,1999:blog-16266256.post-55768567708500537382011-09-17T18:52:00.001-05:002011-09-17T18:52:51.343-05:00We've Moved to PollsAndVotes.comIn the beginning was PoliticalArithmetik, created the weekend Katrina hit New Orleans.<br /><br />In 1996 I co-founded <a href="http://Pollster.com/">Pollster.com</a>. In 2010 HuffingtonPost bought Pollster and I moved on.<br /><br />In 2011 I've created <a href="http://PollsAndVotes.com/">PollsAndVotes.com</a>, a site for more comprehensive analysis of polling and vote data. PollsAndVotes is ramping up for 2012. <a href="http://Pollsandvotes.com/">Come visit</a>.<br /><br />Meanwhile, this site is the archive for PoliticalArithmetik, my first love.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-41715991765914778202008-10-29T20:40:00.003-05:002008-10-29T20:44:55.508-05:00Undecided Voters and Racial Attitudes<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SQkRMvPNgdI/AAAAAAAADDU/lx5RTEKcMSw/s1600-h/PredictedVote.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer; width: 400px; height: 300px;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SQkRMvPNgdI/AAAAAAAADDU/lx5RTEKcMSw/s400/PredictedVote.png" alt="" id="BLOGGER_PHOTO_ID_5262756550095503826" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />How will undecided voters break, and will racial attitudes color their votes?<br /><br />We've seen an enormous amount of speculation but little evidence based on data, so let's try to tip the balance back to empirical evidence.<br /><br />Thanks to the Diageo/Hotline tracking poll data, we can model individual vote choice and see what we would expect of undecided voters.<br /><br />During October 3-11 our colleagues at the Diageo/Hotline poll included a racial attitude question we had previously used in the Big Ten Battleground survey in September and which NBC/Wall Street Journal used in January. That question was shown in both the earlier polls to have a statistically significant effect on vote choice, even after controlling for other political attitudes and demographics.<br /><br />The question text is: "I'd like you to tell me whether you strongly agree, somewhat agree, somewhat disagree or strongly disagree with the following statement. ... African Americans often use race as an excuse to justify wrongdoing"<br /><br />58% of the total sample, and 61% of whites agree either strongly or somewhat. (For comparison, 56% of hispanics and 40% of African Americans agree strongly or somewhat.)<br /><br />I model the vote choice for those who expressed a preference with a model using a variety of attitudes and demographics, including favorability to Obama and McCain, party id, marital status, kids at home, education, race, age, sex, church attendance, region and urban, suburban or rural residence. Then I added the racial attitude responses from the "black excuse" question. To check against people hiding their feelings by refusing to answer the "black excuse" question I also included a variable to capture the effect of refusal to answer.<br /><br />This model produces a predicted probability of voting for McCain or Obama, including predicted probabilities for those who had said they were undecided or who refused to respond to the vote question. From this we can estimate the likely vote of undecided, and compare the estimates to the responses of those who gave a vote preference in the survey.<br /><br />Bottom line: Undecided and refuse to say voters are estimated to break 50% for McCain and 50% for Obama. As even as it gets. There is no evidence here of a large bias towards McCain that is hidden within the undecided respondents.<br /><br />Nor is there evidence of a pronounced racial bias among these undecided voters as compared to the public at large. Among the undecided 27% strongly agree and 32% somewhat agree on the "black excuse" item. For the public as a whole 26% and 32% give the corresponding responses.<br /><br />The model does a good job predicting survey response as well. 97% of both Democratic and Republican voters are predicted by the model to vote that way. For those who say they only "lean" towards one party or the other, 77% of Democratic leaners and 80% of Republican leaners are predicted to vote as they lean. The symmetry of results here suggests that there is not a visible bias in the model estimates for either party or for intensity of preference.<br /><br />Finally, what happens if we ignore racial attitude and predict vote among the undecided without it? The split is 52% Obama to 48% McCain. So at most the impact of incorporating racial attitude in the model is a rise of 2% for McCain among undecided. Given the sample sizes involved, that is well within the margin of error. And if we take out candidate favorability from the model we get estimates of 52-48 without racial attitude and 53-47 with racial attitude.<br /><br />So what can we conclude? There is no evidence of a hidden support for McCain among undecided voters. They split more evenly than does the "decided" pool of respondents, who split 54-46 in this sample (Oct 3-11) but that's well within normal expectations and is a modest difference in any case.<br /><br />Second, the role of racial attitude is important at the individual level, but the aggregate consequence is extremely modest. Some are moved away from Obama yet others are moved towards him. And among the undecided, the distribution of opinion on this measure of racial attitude is virtually identical to that in the population.<br /><br />In a year of endless discussion about racial effects there has been far more speculation and far less data analysis than is good for us. Let's put our data on the table before continuing to opine about this subject.<br /><br /><a href="http://www.pollster.com/blogs/undecided_voters_and_racial_at.php"><span style="font-style: italic;">Cross Posted at Pollster.com</span></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-14532575899468672292008-10-17T00:07:00.002-05:002008-10-17T00:11:37.491-05:00The Road to 270 for McCain<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SPgd_H1MpSI/AAAAAAAADC8/_jDN2TUfxk0/s1600-h/EvoteBarChart.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SPgd_H1MpSI/AAAAAAAADC8/_jDN2TUfxk0/s400/EvoteBarChart.png" alt="" id="BLOGGER_PHOTO_ID_5257985535226193186" border="0" /></a><br /><br /><br /><br /><br /><br />(Click chart to see full size)<br /><br />It takes 270 to win this game. McCain is behind in national polls, down 7.5 in our Pollster.com Trend Estimate. But as you know, this is a game won in the states. So what does it now take for McCain to eek out a 270-268 electoral vote win?<br /><br />The chart above shows the states allocated to candidates based on my Political Arithmetik trend estimate. The classification of states is the same as Pollsters, but differ slightly in the order.<br /><br />The states are ordered left to right according to the Obama minus McCain margin. Yellow states are classed as tossups but are allocated to candidates based on who is ahead in the trend, no matter how small that margin may be. The width of each state's block is proportional to the state's electoral vote.<br /><br />With this classification, Obama has 364 electoral votes to McCain's 174.<br /><br />So what would it take for McCain to come back at this point? Ohio and Florida, above all else.<br /><br />Ohio and Florida are the largest states that are in Obama's row but still close. McCain led in both states in August and the first half of September. Without them, it is hopeless. With them, he still needs more, but they are the necessary conditions for a win.<br /><br />Can he do it? The trends in Ohio and Florida offer a small glimmer of hope. While most states have continued to move in Obama's direction (see PA, MI and WI), these two have leveled off, and in Ohio moved back in McCain's direction.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SPgd_E5BjRI/AAAAAAAADDE/_gwDvOxUlhM/s1600-h/OhioTrend.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SPgd_E5BjRI/AAAAAAAADDE/_gwDvOxUlhM/s400/OhioTrend.png" alt="" id="BLOGGER_PHOTO_ID_5257985534436936978" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SPgd_TnHhDI/AAAAAAAADDM/B_PavbvmZMk/s1600-h/FloridaTrend.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SPgd_TnHhDI/AAAAAAAADDM/B_PavbvmZMk/s400/FloridaTrend.png" alt="" id="BLOGGER_PHOTO_ID_5257985538388362290" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />No matter what, McCain has a long shot to get to 270. But The road has to go through Ohio and Florida and both states are looking better for him than any others he must win. What he is doing in Pennsylvania and Wisconsin is a mystery to me.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-31539143580573643022008-10-12T12:31:00.003-05:002008-10-12T12:41:18.733-05:00Tracking Poll House Effects<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SPI0h2HSBII/AAAAAAAADCk/22pq20eLhAo/s1600-h/dailytrackers.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SPI0h2HSBII/AAAAAAAADCk/22pq20eLhAo/s400/dailytrackers.png" alt="" id="BLOGGER_PHOTO_ID_5256321471161173122" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />There are six daily tracking polls currently reporting data, up from just two (Gallup and Rasmussen) during most of the year. How are they doing?<br /><br />Compared to our Pollster.com trend estimate based on all public polls, not too bad. The trend based on trackers only is close to that for the all polls trend, with an average difference of just 0.35 percentage points, a very slight under-estimate of the Obama minus McCain margin. Recently the difference has been negligible, with most of this difference coming early in the year.<br /><br />A bit of visual inspection shows the GW Battleground poll seemed more out of line until they shifted their party weighting plan after a few days. Likewise Hotline had a couple day "hiccup" but has returned to trend.<br /><br />What about house effects? The range is moderate, from +4.3 points on the margin for Daily Kos, to -4.2 points for Zogby, though the latter has only just started polling so the confidence interval is wide.<br /><br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SPI0iaLLNVI/AAAAAAAADCs/ckrkju-hL0c/s1600-h/TrackerHFX.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SPI0iaLLNVI/AAAAAAAADCs/ckrkju-hL0c/s400/TrackerHFX.png" alt="" id="BLOGGER_PHOTO_ID_5256321480841180498" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-15069602852776112352008-10-06T14:12:00.004-05:002008-10-06T14:26:01.888-05:00National Sensitivity Comparison<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SOpjl129KyI/AAAAAAAADCc/_D7KAUAUCJw/s1600-h/USSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SOpjl129KyI/AAAAAAAADCc/_D7KAUAUCJw/s400/USSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5254121417044994850" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Now that you can play with the sensitivity of the trend estimate on our interactive charts at Pollster.com, the need for my sensitivity comparisons is somewhat less. But, it is interesting to see that just now the sensitivity used in our national trends makes very little practical difference.<br /><br />My pals, "Ready-Red" and "Old-Blue" are in good agreement on both the magnitude of the Obama surge in the last three weeks, and the current standing of about a 7 to 7.5 point Obama lead.<br /><br />Red had a moment of indecision last week when a couple of polls showed McCain ahead, but after barking in that direction, Red came back to Old Blue in seeing continued upward movement for Obama. You gotta love Red for his sensitive nose, but sometimes it distracts him from the big picture.<br /><br />So here is a question to ponder. How much more upward lift can there be for Obama? He's already well beyond his previous best. Does anyone believe he really can hold a 10 point lead through the election? If not, then we should see some flattening out in the next few days, regardless of the debates.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-68399189697493161092008-10-06T13:41:00.003-05:002008-10-06T13:56:20.388-05:00Campaign '08 vs '04 and '00 Update<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SOpcBO0u8yI/AAAAAAAADCM/komZ8VOd79o/s1600-h/Pres08vs04aand000verlay.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SOpcBO0u8yI/AAAAAAAADCM/komZ8VOd79o/s400/Pres08vs04aand000verlay.png" alt="" id="BLOGGER_PHOTO_ID_5254113091510006562" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The 2008 campaign had not seen a really big move in preferences until the financial crisis hit three weeks ago today. Since that time, the Obama-McCain margin has shifted almost 9 points in Obama's favor, converting a small McCain lead into a substantial Obama advantage.<br /><br />This swing reversed the gains McCain made with the Republican convention and the week after during which he picked up about 4 points and took the lead for the first time since March.<br /><br />I wrote earlier that we had not seen a move in 2008 as large as ones we saw in both 2000 and 2004. That is no longer true of 2004, though the current run is not yet as large as the one Gore mounted in 2000.<br /><br />The Bush counter-assault in 2000, after Gore's surge, was almost eight points, and began at almost the same point in the campaign, about 57 days out.<br /><br />Voters are making up their minds at about the same rate as they did in 2000. If this year follows that pattern, look for some serious decision making over the next two weeks.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SOpcBIuD0OI/AAAAAAAADCU/FVil-h1LsRg/s1600-h/DKOverlay.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SOpcBIuD0OI/AAAAAAAADCU/FVil-h1LsRg/s400/DKOverlay.png" alt="" id="BLOGGER_PHOTO_ID_5254113089871401186" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-13800586264042500132008-09-27T10:48:00.007-05:002008-09-27T11:15:05.174-05:00Interactive charts now at Pollster.comIf you can't resist the urge to play with the data, we have new charts at <a href="http://Pollster.com">Pollster.com</a> that can satisfy your need. These are interactive versions of the charts here and previously at Pollster. You can exclude pollsters or methods. You can change the sensitivity of the fit to either more sensitive or less sensitive than our standard fits here.<br /><br />Here is a sample chart for Ohio, using our default values:<br /><br /><script type="text/javascript" src="http://www.pollster.com/flashcharts/scripts/javascript/loess.js"></script><object width="400" height="308"><param name="chart" value="http://www.pollster.com/flashcharts/flash/swfs/chart.swf?xml=http://www.pollster.com/flashcharts/content/xml/08OHPresGEMvO.xml&choices=McCain,Obama&phone=&ivr=&internet=&mail=&smoothing=&from_date=&to_date=&min_pct=&max_pct=&grid=&points=&trends=&lines=&colors=&e=1"></param><param name="allowFullScreen" value="false"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.pollster.com/flashcharts/flash/swfs/chart.swf?xml=http://www.pollster.com/flashcharts/content/xml/08OHPresGEMvO.xml&choices=McCain,Obama&phone=&ivr=&internet=&mail=&smoothing=&from_date=&to_date=&min_pct=&max_pct=&grid=&points=&trends=&lines=&colors=&e=1" type="application/x-shockwave-flash" allowfullscreen="false" allowScriptAccess="always" width="400" height="308"></embed></object><br /><br /><br /><br />And here it is again but mail and Internet polls excluded and more sensitivity:<br /><br /><script type="text/javascript" src="http://www.pollster.com/flashcharts/scripts/javascript/loess.js"></script><object width="400" height="308"><param name="chart" value="http://www.pollster.com/flashcharts/flash/swfs/chart.swf?xml=http://www.pollster.com/flashcharts/content/xml/08OHPresGEMvO.xml&choices=McCain,Obama&phone=&ivr=&internet=0&mail=0&smoothing=more&from_date=&to_date=&min_pct=&max_pct=&grid=&points=&trends=&lines=&colors=&e=1"></param><param name="allowFullScreen" value="false"></param><param name="allowScriptAccess" value="always"></param><embed src="http://www.pollster.com/flashcharts/flash/swfs/chart.swf?xml=http://www.pollster.com/flashcharts/content/xml/08OHPresGEMvO.xml&choices=McCain,Obama&phone=&ivr=&internet=0&mail=0&smoothing=more&from_date=&to_date=&min_pct=&max_pct=&grid=&points=&trends=&lines=&colors=&e=1" type="application/x-shockwave-flash" allowfullscreen="false" allowScriptAccess="always" width="400" height="308"></embed></object><br /><br /><br /><a href="http://www.pollster.com/polls/oh/08-oh-pres-ge-mvo.php">Give it a try</a> and let us know if you run into any problems. You can embed the results of your experiments on your own page, though not the interactive features. <br /><br />At the moment the embedded graphs are scaled at 450 pixels wide. To fit them here I edited the html code to make the width 400 and the height 308. I hope we can automate that soon, but meanwhile if your width is fixed and below 450, changing two lines in the embedded html will fix it for you.<br /><br />These charts are available for a growing number of states at Pollster.com. Stop by and play!<br /><br />CharlesCharles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-53382379877789038372008-09-22T11:24:00.003-05:002008-09-22T11:33:05.538-05:00Obama Recovery Across Red, Yellow and Blue States<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SNfHCshnfvI/AAAAAAAADB8/msUERAcAdW4/s1600-h/NationalTrend.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SNfHCshnfvI/AAAAAAAADB8/msUERAcAdW4/s400/NationalTrend.png" alt="" id="BLOGGER_PHOTO_ID_5248882739849428722" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Obama has now recovered his lead in national polling, rising at or above his post-DNC, pre-RNC level. This sharp turnaround erases the very sharp pro-McCain/Palin convention bounce we saw in early September.<br /><br />But the Obama recovery is not concentrated in Democratic states. As with the McCain advantage, this turn is visible in all three types of states-- Red, Yellow and Blue.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SNfHDJh3bLI/AAAAAAAADCE/R5yop6MLU_Y/s1600-h/BluesRedsPostRNC.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SNfHDJh3bLI/AAAAAAAADCE/R5yop6MLU_Y/s400/BluesRedsPostRNC.png" alt="" id="BLOGGER_PHOTO_ID_5248882747635100850" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The biggest recovery is actually in the Red states, where McCain enjoyed his biggest bounce. Those states are not back where they started, or even a shade less pro-McCain, but they are a far ways from being "close".<br /><br />The states we have classified as tossup or leans (what I'm calling yellow here, though on the map leans are light red or blue) have also seen a significant Obama recovery. The range of movement is rather modest, but the roughly three point McCain gain has now been balanced by a 3+ point Obama recovery in these most contested states, putting Obama up by just over a point.<br /><br />Dem states showed a small move to McCain and have now seen an Obama recovery, though with a one point fall off most recently.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-50229576401696994052008-09-15T15:06:00.006-05:002008-09-15T15:58:35.903-05:00McCain Gains Not Limited to Red States<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SM7IBEnBnRI/AAAAAAAADBs/tykv8nb2Zk4/s1600-h/BluesRedsPostRNC.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SM7IBEnBnRI/AAAAAAAADBs/tykv8nb2Zk4/s400/BluesRedsPostRNC.png" alt="" id="BLOGGER_PHOTO_ID_5246350536676056338" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Obama advisor David Axelrod is quoted in today's <a href="http://www.washingtonpost.com/wp-dyn/content/article/2008/09/14/AR2008091402587.html">Washington Post article by Dan Balz and Peter Slevin</a>:<br /><br /><blockquote>"I think one of the things driving the national polls is that the red states are redder," said David Axelrod, one of Obama's closest advisers. "In the battleground states, the race has held pretty firm." </blockquote><br /><br />An interesting claim. Let's take a look at the data based on state polls, rather than national.<br /><br />Among the strong Republican states, McCain has gained more than 8 points over Obama since shortly before the conventions, turning a 14 point lead into a 22.5 point margin, a huge gain.<br /><br />Among the strong Democratic states, the effect of the conventions is a tiny 2 point move in McCain's direction, from an Obama lead of 12 points before to 10 points now.<br /><br />But the rest of the states, rated lean or toss up, have also shown movement. These swing states had a 1.5 point Obama lead before the conventions, and that has now turned into a 3 point McCain lead, a 4.5 point shift.<br /><br />So Axelrod is right that the biggest gains for McCain have come in the reddest of states, and those may influence national polling. But the evidence doesn't back his second claim, that the battleground has held firm, unless of course you mean they are still battleground states. But now battlegrounds that on balance favor McCain rather than favor Obama as they did before the conventions.<br /><br />One caution: the lean and tossup states are themselves heterogeneous, so a single trend estimate such as the 4.5 McCain lead here is itself a simplification. If you wanted to focus on the six or eight states that probably hold the key to the electoral vote, you could slice this more finely.<br /><br />We currently rate eight states as pure tossup: NH, VA, OH, MI, CO, NM, NV and MT. (Note the last has few polls and the latest 9/8 shows a 53-42 McCain lead. But it does fit our statistical criteria, and Montana was listed by the Obama campaign as a target state.)<br /><br />When we fit the data to just these eight tossup states, we see a 3.5 point move in McCain's direction, from a 2 point Obama lead to a 1.5 point McCain lead. Only a point less shift than among all lean and tossup states.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SM7IBeDLPeI/AAAAAAAADB0/nZCabzl-bUA/s1600-h/TossupsPostRNC.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SM7IBeDLPeI/AAAAAAAADB0/nZCabzl-bUA/s400/TossupsPostRNC.png" alt="" id="BLOGGER_PHOTO_ID_5246350543505014242" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />No matter how you slice it, the battleground states have a lot of battle left in them, and campaign events are having effects across all states, though larger in some than others.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-59093104003925464492008-09-12T14:13:00.003-05:002008-09-12T14:26:39.776-05:00Alaska Post-Palin<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SMq_ctVUCBI/AAAAAAAADBc/K17LYCvplME/s1600-h/AlaskaPostPalin.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SMq_ctVUCBI/AAAAAAAADBc/K17LYCvplME/s400/AlaskaPostPalin.png" alt="" id="BLOGGER_PHOTO_ID_5245215215952594962" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Alaska has long been a solidly "red" state but this year the troubles of the state's Senator Ted Stevens and Representative Don Young on top of Republican party "brand" troubles suggested there might be an opportunity for the Obama campaign which spent $88,000 in advertising in the state in June and July according to the <a href="http://wiscadproject.wisc.edu/">Wisconsin Advertising Project</a>.<br /><br />And then came Sarah Palin to the Republican ticket. The impact is obvious in the chart above.<br /><br />While the state was classified as "lean Republican" prior to the Palin Pick, all but one poll in the state showed McCain ahead. Now there is no doubt.<br /><br />The politics are obvious, of course, but it is a nice example of how a political event can be instantly reflected in the polling, and bring our trend estimator to a sharply different conclusion.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-72924555299989303162008-09-12T13:28:00.003-05:002008-09-12T13:45:55.600-05:00State and National Polling Post-Convention<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SMq1F_jM5fI/AAAAAAAADBU/_a6R3tFyjuc/s1600-h/PostRNCStateBounce.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SMq1F_jM5fI/AAAAAAAADBU/_a6R3tFyjuc/s400/PostRNCStateBounce.png" alt="" id="BLOGGER_PHOTO_ID_5245203830589416946" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The gains of the Republican ticket continue in both state and national polling as more post-convention state polls become available. We now have 26 states with a post-convention poll and the results mirror the sharply pro-Republican movement seen in national polling since Sen. McCain's acceptance speech.<br /><br />The McCain lead is now about 3 points in national polling and is just under 4 points for those states with post-convention polls.<br /><br />An important point is that the states with post-convention polls are not a representative sample of all states, though the differences between states without a recent poll and those with new polls is not large. States without new polling have averaged 2.1 percentage points more pro-Obama than those states with new polling. However, if we plot the trend lines in the chart for all states (with or without new polls) and for those with post-convention polls, we see the two trends have followed similar if not identical trajectories. <br /><br />Since <a href="xhttp://politicalarithmetik.blogspot.com/2008/09/post-convention-bounce-in-states.html">our last update</a> of this comparison of state and national trends the addition of new states has brought the state trend line a bit below the national polls trend, something not so visible in the earlier post. This difference reflects the selection of states that have new polling, rather than shifts in the vote margin in the states, except of course for the brand new polls.<br /><br />The bottom line is that the swing towards the Republicans remains strong in both state and national polls , amounting to a 7 point national swing and a 5 point swing based on the state polls. <a href="http://politicalarithmetik.blogspot.com/2008/08/polling-trends-in-2008-vs-04-and-00.html">In an earlier post</a>, I pointed out<br /><blockquote>The bottom line is neither campaign should be complacent or despondent. There is a lot of time left and recent history shows that both up and down swings of 6-9 points are entirely plausible.<br /></blockquote>Right now that magnitude of swing is looking about right.<br /><br /><br />The states with post-convention polls are: Alabama, Alaska, Colorado, Florida, Georgia, Idaho, Maine, Maryland, Michigan, Mississippi, Missouri, Montana, Nevada, New Hampshire, New Jersey, New Mexico, North Carolina,North Dakota, Ohio, Oklahoma, Pennsylvania, Virginia, Washington, West Virginia, Wisconsin, Wyoming.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-17405100752896656972008-09-10T17:38:00.003-05:002008-09-10T18:52:46.189-05:00Ins and Outs of PollingI did an hour on Minnesota Public Radio on September 10 discussing polling techniques and issues. Here is a link to the audio. Good callers!<br /><br />The focus on polling starts at 11:00 minutes into the show.<br /><br /><script type="text/javascript" src="http://minnesota.publicradio.org/www_publicradio/tools/media_player/js/swfobject.js"></script><div id="minnesota/news/programs/2008/09/10/midday/midday_hour_1_20080910_64s_player"></div><script language="javascript">/*<![CDATA[*/var so = new SWFObject("http://minnesota.publicradio.org/www_publicradio/tools/media_player/s_player.swf", "minnesota/news/programs/2008/09/10/midday/midday_hour_1_20080910_64s_player", "319", "83", "8", "#ffffff");so.addParam("quality", "high");so.addParam("menu", "false");so.addParam("wmode", "transparent");so.addVariable("name", "minnesota/news/programs/2008/09/10/midday/midday_hour_1_20080910_64");so.write("minnesota/news/programs/2008/09/10/midday/midday_hour_1_20080910_64s_player");/*]]>*/</script>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-85085717081378501942008-09-10T15:54:00.003-05:002008-09-10T16:14:55.729-05:00Post Convention Bounce in the States<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SMg0PvSmU6I/AAAAAAAADBM/FMJdVMGW6tw/s1600-h/PostRNCStateBounce.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SMg0PvSmU6I/AAAAAAAADBM/FMJdVMGW6tw/s400/PostRNCStateBounce.png" alt="" id="BLOGGER_PHOTO_ID_5244499211070100386" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The McCain campaign has gained significant support in national polling since the end of the Republican Convention, but what about the state polls? Has the shift also been reflected there?<br /><br />State pollsters appeared to go on vacation for the conventions, with very little new polls during the two weeks of conventions (and the week before). Now the pollsters are back, tanned and rested and ready to go. We've added 17 new state polls since the RNC ended, and while we'd love to see more, it is enough to get started with some analysis.<br /><br />The chart above shows the national trend in blue and the trend based on those states with post-convention polls in purple. Over the course of the year, the two trends have followed each other rather well with some small differences in details but qualitatively similar patterns of up and down movement.<br /><br />Now in the post-RNC period, the states with new polls match the national polls quite closely, both giving estimates of about a one point McCain lead, with the states maybe a shade less than that.<br /><br />This post-convention bounce may or may not last, but at the moment the evidence is that it is moving across the states (and these are mostly competitive states) at about the same rate as it is for the national polls.<br /><br />The state polls show no positive DNC upward bounce, but that's because there were practically no new polls during that period, so don't jump to that conclusion. It is an artifact of no polls.<br /><br />States for which we have new polls are Colorado, Florida, Maryland, Michigan, Montana, New Jersey, North Carolina, Ohio, Oklahoma, Pennsylvania, Virginia, Washington and Wisconsin.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-90474001057025130382008-09-08T12:51:00.004-05:002008-09-08T13:08:49.204-05:00Republican Bounce and Trend Sensitivity<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SMVmMNlBykI/AAAAAAAADBE/ik2HQXJsOjY/s1600-h/USSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SMVmMNlBykI/AAAAAAAADBE/ik2HQXJsOjY/s400/USSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5243709701132241474" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The post-convention bounce is now moving in the Republican direction, but with an enormous spread in estimates. A Gallup/USA Today (9/5-7) has an enormous 10 point McCain lead over Obama, 54%-44%. In contrast, Gallup's tracker over the same days shows a 5 point McCain lead, 49%-44%. Now would be a good time to note that the tracker is a registered voter (RV) sample, while the Gallup/USAT is a likely voter (LV) sample. LV samples typically are more favorable for Republican candidates, so at least some of this difference is probably due to these different sampling frames. We'll no doubt be talking a lot about this issue in days ahead.<br /><br />But other polls on the same days show a tied race. Diageo/Hotline has the race 44%-44% and CNN has it 48%-48%. And Zogby's Internet poll done 9/5-6 puts the race at 50%-46%.<br /><br />All of these are much better for McCain than the 5-9 point Obama leads we saw in the immediate aftermath of the Democratic convention.<br /><br />So it looks like both parties got nice convention bounces.<br /><br />Our trend estimate is still hungry for more data. The standard, blue line, estimate is now less persuaded that Obama had a convention bounce OR that McCain is getting one either. That is standard behavior of our estimator which is designed to be a bit conservative when faced with conflicting polls and short term changes of trend.<br /><br />But that is why we have our "sensitive" estimator for comparison. The red line is a trend estimate that is about twice as sensitive a the blue line. It is considerably quicker to respond to short term changes and to fewer polls. The down side is it will often chase random noise.<br /><br />Since there is good reason to believe convention bounces are real, it is reasonable to think that the red line's indication that the race has indeed tightened is probably a real signal in the data, and not just noise. On the other hand, the Gallup 10 point McCain lead is out of the range of any other current polling data. So "red" may be chasing that outlier just a bit more than is good for him. As the figure makes clear, red and blue usually agree quite closely after enough data are in hand, but can diverge especially when data are sparce.<br /><br />A prudent approach is to wait for a few more post-convention and post-weekend interviewing polls to see just how big and how sustained the RNC bounce is. But both estimators agree we have ourselves a real horserace now.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-2300627854797177842008-08-29T07:39:00.003-05:002008-08-29T07:46:09.890-05:00State Battlegrounds and Home Grounds<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLfuYkmJveI/AAAAAAAADAk/7jUdqMHN4HU/s1600-h/StatusObama.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLfuYkmJveI/AAAAAAAADAk/7jUdqMHN4HU/s400/StatusObama.png" alt="" id="BLOGGER_PHOTO_ID_5239918797376830946" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />A quickie from Detroit Metro Airport.<br /><br /><a href="http://www.pollster.com/blogs/plouffe_on_obama_and_polling.php">Mark Blumenthal reported on an interview with Obama campaign manager David Plouffe</a> yesterday at Pollster. Plouffe discussed the 18 states the Obama campaign sees as their target states, and Mark reported what states those were in his post.<br /><br />Here we take a quick look at the polling in those states. The chart above is sorted by the Obama minus McCain margin, and shows the 95% confidence interval. The dot size is proportional to electoral vote.<br /><br />Below I show the status of the states based on our polling categorization of each state.<br /><br />Time to run for the plane.<br /><br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLfuYnNjgUI/AAAAAAAADAs/Xw1WP04DoKE/s1600-h/StatusBG.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLfuYnNjgUI/AAAAAAAADAs/Xw1WP04DoKE/s400/StatusBG.png" alt="" id="BLOGGER_PHOTO_ID_5239918798078968130" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLfuY96oczI/AAAAAAAADA0/7kOCXJxbalo/s1600-h/StatusSR.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLfuY96oczI/AAAAAAAADA0/7kOCXJxbalo/s400/StatusSR.png" alt="" id="BLOGGER_PHOTO_ID_5239918804173615922" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLfuY5v3SWI/AAAAAAAADA8/6LbF-jjY_jY/s1600-h/StatusSD.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLfuY5v3SWI/AAAAAAAADA8/6LbF-jjY_jY/s400/StatusSD.png" alt="" id="BLOGGER_PHOTO_ID_5239918803054709090" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-64157178040164364582008-08-27T08:13:00.004-05:002008-08-27T08:54:37.299-05:00McCain, Obama and Clinton Favorability<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLVUTU1tXSI/AAAAAAAADAc/ZJMdL3rkS1s/s1600-h/FavBOJMHC.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLVUTU1tXSI/AAAAAAAADAc/ZJMdL3rkS1s/s400/FavBOJMHC.png" alt="" id="BLOGGER_PHOTO_ID_5239186432503668002" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />A little interesting movement in views of the candidates has taken place since the end of the primaries in June. All three candidates, McCain, Obama and Clinton, have seen rises in their favorable ratings and an initial decline in unfavorable views though with a slight upturn recently. McCain and Obama are enjoying essentially identical ratings, with 60% favorable and only 35% unfavorable. Even after a significant amount of negative portrayals of him in RNC and McCain ads, Obama's rating has risen over the summer, and so has McCain's. (According to the <a href="http://wiscadproject.wisc.edu/">Wisconsin Advertising Project</a>, which monitored and coded all 100,000 ad airings in June and July, one third of McCain's ads contained negative information about Obama and 100% of RNC ads were negative. In the same two months, 10% of Obama's ads mentioned McCain.)<br /><br />Whatever happens after the conventions, both candidates enjoy an enviable standing with voters as attractive figures instead of a pair of lesser evils. The fall capaign may alter this, but even after a hard fought primary season the nominees remain attractive figures.<br /><br />Meanwhile, Senator Clinton has also enjoyed an upturn in favorable ratings and a decline in unfavorable ratings since the end of the primary season. While improved, Clinton remains a more polarizing figure than either McCain or Obama, with slightly lower favorable but noticeably higher negative ratings. <br /><br />Senator Clinton is far more popular among Democrats than among either Independents or (especially) Republicans. In that sense, her speech to the Democratic Convention last night was an example of speaking primarily to the party and her supporters, rather than to the broader public. The contast between former Virginia governor and now Senate candidate Mark Warner's speech and Clinton's is a good example of this difference. Warner stressed unifying themes and appeals across political groups, which was greated warmly but which fell short of electrifying the Democratic delegates. In contrast, Clinton played to the party and produced a predictably enthusiastic response within the DNC convention hall. Conventions contain both elements. Monday, the party celebrated Sen. Kennedy's life and family legacy, primarily an inside the family affair, perhaps touching some independents but not likely to attract Republicans. In contrast Michelle Obama's speech could have easily been given at the Republican convention, with its themes of family, hard work, pulling oneself up from working class circumstances. Hers was a speech designed to reach out beyond the party.<br /><br />The one remaining question from the Clinton speech is whether her supporters also resepect her enough to follow her lead. For Clinton to be a power in the party includes the requirement that she be able to deliver her supporters for Obama. If any significant number of her supporters refuse to be delivered, they reduce her status as a result. This is hard to judge from the cable news coverage, who can easily find individual delegates willing to say they are unpersuaded. But what effect the Clinton speech has with her supporters outside the convention hall will be critical.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-25359720460958313502008-08-24T15:29:00.009-05:002008-08-24T17:07:37.995-05:00How Pollsters Affect Poll Results<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIxiiuBjI/AAAAAAAADAM/FWLKcTVUql0/s1600-h/HouseEfx.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIxiiuBjI/AAAAAAAADAM/FWLKcTVUql0/s400/HouseEfx.png" alt="" id="BLOGGER_PHOTO_ID_5238188595020170802" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Who does the poll affects the results. Some. These are called "house effects" because they are systematic effects due to survey "house" or polling organization. It is perhaps easy to think of these effects as "bias" but that is misleading. The differences are due to a variety of factors that represent reasonable differences in practice from one organization to another.<br /><br />For example, how you phrase a question can affect the results, and an organization usually asks the question the same way in all their surveys. This creates a house effect. Another source is how the organization treats "don't know" or "undecided" responses. Some push hard for a position even if the respondent is reluctant to give one. Other pollsters take "undecided" at face value and don't push. The latter get higher rates of undecided, but more important they get lower levels of support for both candidates as a result of not pushing for how respondents lean. And organizations differ in whether they typically interview adults, registered voters or likely voters. The differences across those three groups produce differences in results. Which is right? It depends on what you are trying to estimate-- opinion of the population, of people who can easily vote if the choose to do so or of the probable electorate. Not to mention the vagaries of identifying who is really likely to vote. Finally, survey mode may matter. Is the survey conducted by random digit dialing (RDD) with live interviewers, by RDD with recorded interviews ("interactive voice response" or IVR), or by internet using panels of volunteers who are statistically adjusted in some way to make inferences about the population.<br /><br />Given all these and many other possible sources of house effects, it is perhaps surprising the net effects are as small as they are. They are often statistically significant, but rarely are they notably large.<br /><br />The chart above shows the house effect for each polling organization that has conducted at least five national polls on the Obama-McCain match-up since 2007. The dots are the estimated house effects and the blue lines extend out to a 95% confidence interval around the effects.<br /><br />The largest pro-Obama house effect is that of Harris Interactive, at just over 4 points. The poll most favorable to McCain is Rasmussen's Tracking poll at just less than -3 points. Everyone else falls between these extremes.<br /><br />Now let's put this in context. We are looking at effects on the <span style="font-weight: bold;">difference</span> between the candidates, so that +4 from Harris is equivalent to two points high on Obama and two points low on McCain. Taking half the estimated effect above gives the average effect per candidate. The average effects are at most 2 points per candidate. Not trivial, but not huge.<br /><br />Estimating the house effect is not hard. But knowing where "zero" should be is very hard. A house effect of zero is saying the pollster perfectly matches some standard. The ideal standard, of course, is the actual election outcome. But we don't know that now, only after the fact in November. So the standard used here is the house effect relative to our Pollster Trend Estimate. If a pollster consistently runs 2 points above our trend, their house effect would be +2.<br /><br />The house effects are calculated so that the average house effect is zero. This doesn't depend on how many polls a pollster conducts. And it doesn't mean the pollster closest to zero is the "best". It just means their results track our trend estimate on average. That can also happen if a pollster gyrates considerably above and below our trend, but balances out. A nicer result is a poll that closely follows the trend. But either pattern could produce a house effect near zero. For example, Democracy Corps and Zogby have very similar house effects near -1. But look at their plots below and you see that Democracy Corps has followed our trend quite closely, though about a point below the trend. Zogby has also been on average a point below trend, but his polls have shown large variation around the trend, with some polls as near-outliers above while others are near outliers below the trend. The net effect is the same as for Democracy Corps, but the variability of Zogby's results is much higher.<br /><br />Incidentally, the Democracy Corps poll is conducted by the Democratic firm of Greenberg Quinlan Rosner Reserch in collaboration with Democratic strategist James Carville. Yet the poll has a negative house effect of -1. Does this mean the Democracy Corps poll is biased against Obama? No. It means they use a likey voter sample, which typically produces modestly more pro-Republican responses than do registered voter or adult samples. Assuming that the house effect necessarily reflects a partisan bias is a major mistake.<br /><br />How can you use these house effects? Take a pollster's latest results and subtract the house effect from their reported Obama minus McCain difference. That puts their results in the same terms as all others, centered on the Pollster.com Trend Estimate. This is especially useful if you are comparing results from two pollsters with different house effects. Removing those house differences makes their results more comparable.<br /><br />What impact do house effects have on our Pollster.com Trend Estimate? A little. Our estimator is designed to resist big effects of any single pollster, but it isn't infallible, especially when some pollsters do far more polls than others or when one pollster dominates during some small period of time. We can estimate house effects, adjust for these, and reestimate our trend with house effects removed. The result runs through the center of the polls, but doesn't allow the number of polls done by an organization to be as influential.<br /><br />The results are shown in the chart below. The blue line is our standard estimator and the red line is the estimate with house effects removed. Without house effects the current trend stands at +2.0 while ignoring house effects produces an estimate of +1.7. A little different, but given the range of variability across polls and the uncertainty as to where the race "really" stands, this is not a big effect.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIxsTnYVI/AAAAAAAADAU/-M_bm6j9570/s1600-h/nofxtrend.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIxsTnYVI/AAAAAAAADAU/-M_bm6j9570/s400/nofxtrend.png" alt="" id="BLOGGER_PHOTO_ID_5238188597641175378" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The impact of house effects isn't always this small. Looking back along the trend we see that the red and blue lines diverged by as much as 1 point in late June, an effect due significantly to the large number of Rasmussen and Gallup tracking polls during that time and few polls with positive house effects in that period. A smaller but still notable divergence occurred in late February and early March. <br /><br />The bottom line is that there are real and measurable differences between polling organizations, but the magnitude of these effects is considerably less than some commentary would suggest. Many of the house effect estimates above are not statistically different from zero. Even ignoring that, the range of effects is rather small, though of course in a tight race the differences may be politically important. Finally, the effects on our Pollster.com Trend Estimate is detectable but does not lead to large distortions, even if we can see some noticeable differences at some times.<br /><br />The charts below move though all the pollsters and plots their poll results compared to the standard trend and the trend removing house effects. Pollsters with fewer than 5 polls are all lumped together as "Other" pollsters. Once they get to our minimum number of polls, we'll have house effects for them too.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIn-eyn1I/AAAAAAAAC_8/P0zbgpXC-g8/s1600-h/HouseFXPollsterCompare-1.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIn-eyn1I/AAAAAAAAC_8/P0zbgpXC-g8/s400/HouseFXPollsterCompare-1.png" alt="" id="BLOGGER_PHOTO_ID_5238188430721195858" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIoZz0mNI/AAAAAAAADAE/-7qvad8zxyw/s1600-h/HouseFXPollsterCompare-2.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIoZz0mNI/AAAAAAAADAE/-7qvad8zxyw/s400/HouseFXPollsterCompare-2.png" alt="" id="BLOGGER_PHOTO_ID_5238188438057162962" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZCEOpWI/AAAAAAAAC_U/mvE2ik1EI8o/s1600-h/HouseFXPollsterCompare-3.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZCEOpWI/AAAAAAAAC_U/mvE2ik1EI8o/s400/HouseFXPollsterCompare-3.png" alt="" id="BLOGGER_PHOTO_ID_5238188173985490274" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZYG9U_I/AAAAAAAAC_c/AyWeMy0XS-w/s1600-h/HouseFXPollsterCompare-4.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZYG9U_I/AAAAAAAAC_c/AyWeMy0XS-w/s400/HouseFXPollsterCompare-4.png" alt="" id="BLOGGER_PHOTO_ID_5238188179902518258" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIZglqPhI/AAAAAAAAC_k/xW_pgSZT4UQ/s1600-h/HouseFXPollsterCompare-5.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIZglqPhI/AAAAAAAAC_k/xW_pgSZT4UQ/s400/HouseFXPollsterCompare-5.png" alt="" id="BLOGGER_PHOTO_ID_5238188182178774546" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIZ_RVCaI/AAAAAAAAC_s/hDPcj5XZTpA/s1600-h/HouseFXPollsterCompare-6.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHIZ_RVCaI/AAAAAAAAC_s/hDPcj5XZTpA/s400/HouseFXPollsterCompare-6.png" alt="" id="BLOGGER_PHOTO_ID_5238188190414997922" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZwwPkvI/AAAAAAAAC_0/-FmdwtuXQHE/s1600-h/HouseFXPollsterCompare-7.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIZwwPkvI/AAAAAAAAC_0/-FmdwtuXQHE/s400/HouseFXPollsterCompare-7.png" alt="" id="BLOGGER_PHOTO_ID_5238188186518131442" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIDu93kpI/AAAAAAAAC-s/VLLeNjdgg2A/s1600-h/HouseFXPollsterCompare-8.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SLHIDu93kpI/AAAAAAAAC-s/VLLeNjdgg2A/s400/HouseFXPollsterCompare-8.png" alt="" id="BLOGGER_PHOTO_ID_5238187808081285778" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHIDwdMD3I/AAAAAAAAC-0/shDVatFQB2U/s1600-h/HouseFXPollsterCompare-9.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHIDwdMD3I/AAAAAAAAC-0/shDVatFQB2U/s400/HouseFXPollsterCompare-9.png" alt="" id="BLOGGER_PHOTO_ID_5238187808481087346" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHID8NRK6I/AAAAAAAAC-8/iIpxs2JEDBs/s1600-h/HouseFXPollsterCompare-10.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHID8NRK6I/AAAAAAAAC-8/iIpxs2JEDBs/s400/HouseFXPollsterCompare-10.png" alt="" id="BLOGGER_PHOTO_ID_5238187811635538850" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHIEVoi3YI/AAAAAAAAC_E/ilOMHdChQds/s1600-h/HouseFXPollsterCompare-11.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHIEVoi3YI/AAAAAAAAC_E/ilOMHdChQds/s400/HouseFXPollsterCompare-11.png" alt="" id="BLOGGER_PHOTO_ID_5238187818460831106" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIEgPgJII/AAAAAAAAC_M/TmY5Ud3X74E/s1600-h/HouseFXPollsterCompare-12.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHIEgPgJII/AAAAAAAAC_M/TmY5Ud3X74E/s400/HouseFXPollsterCompare-12.png" alt="" id="BLOGGER_PHOTO_ID_5238187821308585090" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHd7FYMTI/AAAAAAAAC-E/r59URzYc-kw/s1600-h/HouseFXPollsterCompare-13.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHd7FYMTI/AAAAAAAAC-E/r59URzYc-kw/s400/HouseFXPollsterCompare-13.png" alt="" id="BLOGGER_PHOTO_ID_5238187158498980146" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHHeD-Um5I/AAAAAAAAC-M/ZSUppTM3UhI/s1600-h/HouseFXPollsterCompare-14.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHHeD-Um5I/AAAAAAAAC-M/ZSUppTM3UhI/s400/HouseFXPollsterCompare-14.png" alt="" id="BLOGGER_PHOTO_ID_5238187160885304210" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHHednNnUI/AAAAAAAAC-U/SCaXOXa7jq8/s1600-h/HouseFXPollsterCompare-15.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHHednNnUI/AAAAAAAAC-U/SCaXOXa7jq8/s400/HouseFXPollsterCompare-15.png" alt="" id="BLOGGER_PHOTO_ID_5238187167767698754" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHeQMaa-I/AAAAAAAAC-c/WEqD0iX2-3c/s1600-h/HouseFXPollsterCompare-16.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHeQMaa-I/AAAAAAAAC-c/WEqD0iX2-3c/s400/HouseFXPollsterCompare-16.png" alt="" id="BLOGGER_PHOTO_ID_5238187164165630946" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHeg5tVBI/AAAAAAAAC-k/8iNLRysiKI8/s1600-h/HouseFXPollsterCompare-17.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHHeg5tVBI/AAAAAAAAC-k/8iNLRysiKI8/s400/HouseFXPollsterCompare-17.png" alt="" id="BLOGGER_PHOTO_ID_5238187168650581010" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGnwlBRAI/AAAAAAAAC9c/ve6c-E7PJ3k/s1600-h/HouseFXPollsterCompare-18.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGnwlBRAI/AAAAAAAAC9c/ve6c-E7PJ3k/s400/HouseFXPollsterCompare-18.png" alt="" id="BLOGGER_PHOTO_ID_5238186227965969410" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGoBLUSQI/AAAAAAAAC9k/DjVeXcAlbXw/s1600-h/HouseFXPollsterCompare-19.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGoBLUSQI/AAAAAAAAC9k/DjVeXcAlbXw/s400/HouseFXPollsterCompare-19.png" alt="" id="BLOGGER_PHOTO_ID_5238186232421566722" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGoZZ7BpI/AAAAAAAAC9s/ciWItQx7Z1g/s1600-h/HouseFXPollsterCompare-20.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SLHGoZZ7BpI/AAAAAAAAC9s/ciWItQx7Z1g/s400/HouseFXPollsterCompare-20.png" alt="" id="BLOGGER_PHOTO_ID_5238186238925276818" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHGoX2B-9I/AAAAAAAAC90/ZhfXy4mIKjU/s1600-h/HouseFXPollsterCompare-21.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://2.bp.blogspot.com/_MRs_Nt465oE/SLHGoX2B-9I/AAAAAAAAC90/ZhfXy4mIKjU/s400/HouseFXPollsterCompare-21.png" alt="" id="BLOGGER_PHOTO_ID_5238186238506302418" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHGosuhAqI/AAAAAAAAC98/GR1-24-4-u0/s1600-h/HouseFXPollsterCompare-22.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SLHGosuhAqI/AAAAAAAAC98/GR1-24-4-u0/s400/HouseFXPollsterCompare-22.png" alt="" id="BLOGGER_PHOTO_ID_5238186244111925922" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-66102603247525006802008-08-11T15:41:00.003-05:002008-08-11T21:32:35.645-05:00Age, Turnout and Votes<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://3.bp.blogspot.com/_MRs_Nt465oE/SKCkedMbt6I/AAAAAAAAC8E/N7QWTt3nlnk/s1600-h/Turnoutbyage.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://3.bp.blogspot.com/_MRs_Nt465oE/SKCkedMbt6I/AAAAAAAAC8E/N7QWTt3nlnk/s400/Turnoutbyage.png" alt="" id="BLOGGER_PHOTO_ID_5233363610144323490" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />It's all about who votes. Those that do win. Those that don't lose. The chronic losers in American politics are the young who famously turn out at low rates election after election.<br /><br />This year, those young people are of great interest. Allegedly they will be mobilized in huge numbers, and allegedly they will vote strongly for Barack Obama. The latest available Gallup weekly estimate (July 28-Aug 3) shows Obama leading 56%-35% among 18-29 year olds, while McCain leads 46%-37% among those 65 and older.<br /><br />But will the young vote? And how much difference does it make when they don't?<br /><br />The chart above shows the turnout rate by age for 2000 and 2004, based on the Census Bureau's "Current Population Survey (CPS)", the largest and best source of detailed data on turnout. The most striking result is just how low turnout is among those under 30 compared to older voters. No age group 18-29 managed to reach 45% turnout in 2000, and only two made it in 2004. Not one single age group over 30 fell so low in either year. Despite a little noise for each group, the pattern is a strong rise in participation rates with every year of age at least until the late 60s, after which there is some decline. Yet even among those 85 and over the turnout rate remains above 55%, more then 10 points higher than among their 20-something grandchildren and great-grandchildren.<br /><br />The second striking feature of the chart is that the young can be mobilized a bit, under the right circumstances. Turnout among those under 30 rose significantly in 2004 compared to 2000. While turnout went up among all age groups, the relative gain was clearly greater among those under 30. While mobilizing the young is difficult, these data show that it is possible to get significant gains, at least relative to past turnout.<br /><br />Even so, the "highly mobilized" 20-somethings of 2004 still fell behind the turnout of their 30-something older siblings. A supposed Obama-surge among the young may still not catch up with those even a bit older.<br /><br />The irony is that the young are a large share of the population, but not of the electorate. The chart below shows the population by age in 2004 (it shifts a little by 2008 but not enough to change the story.)<br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SKCker6_aTI/AAAAAAAAC8M/gQX7Zu1NvT4/s1600-h/ShareofPopbyage.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SKCker6_aTI/AAAAAAAAC8M/gQX7Zu1NvT4/s400/ShareofPopbyage.png" alt="" id="BLOGGER_PHOTO_ID_5233363614097697074" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The "boomers" in their 40s and 50s remain the largest group, but for our purposes there are two important points. Those under 30 make up a substantial share of the population, while those 60 and over represent a substantially smaller share at each age.<br /><br />In 2004 those 18-29 were 21.8% of the population, while those 58-69 were just 13.2%. Add in the 11.5% 70 and up, and you get just 24.7% of "geezers" over 58 vs. 21.8% of "kids". But the sly old geezers know a thing or two about voting. Shift from share of the population to share of the electorate and the advantage shifts to the old: 18-29 year olds were just 16% of the electorate in 2004, while those 58-69 were an almost equal 15.9%. Add in the 70+ group at 13.4% and the geezers win hands down: 29.3% of voters vs 16% for the young. That difference is the power of high turnout. It goes a long way to explaining why Social Security is the third rail of American politics.<br /><br />High turnout buys "over-representation". Divide share of voters by share of the population and you get proportionate representation. A ratio of 1.0 means a group votes proportionate to its size. Values over 1 are overrepresented groups. In 2004, for example, 55 year olds were represented 20% more than their population would suggest, with a 1.2 score. The youngest voters, 18 year olds, had an abysmal representation rate of 0.49 in 2000, less than half their share of the population.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SKCkevxYJgI/AAAAAAAAC8U/Uixcai7OUqw/s1600-h/Representationbyage.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SKCkevxYJgI/AAAAAAAAC8U/Uixcai7OUqw/s400/Representationbyage.png" alt="" id="BLOGGER_PHOTO_ID_5233363615131117058" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />While turnout rises with age, it is not until we hit 40 or so that we reach "fair" representation (1.0). After that, every age group is over-represented in the electorate. Less than 40, and every age group is under-represented. (Two small exceptions-- so sue me.)<br /><br />So what are the implications? If you gave me a choice of being wildly popular with the young or moderately popular with the old, I'd take the old any day. They are far more reliable in voting, and while their population numbers are small they more than make up for it in over-representation thanks to turnout differences.<br /><br />There is much conversation about "youth" turnout this year. Perhaps we will indeed see another rise, as we did in 2004. But unless something truly unprecedented occurs, no one can win on the young alone. The gap in turnout is simply too large.<br /><br />But is age destiny? If there were constant differences in partisan preference by age, then perhaps so. But there aren't. Despite being supposedly "old and set in their ways", those 60 and up shifted their votes more than any other age group between 2000 and 2004. In 2000, the 60+ vote went to Gore by a 4 point margin. In 2004, however, those 60+ went for Bush by 8 points. That net 12 point swing, multiplied by their over-representation means a lot.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SKCkey_bLLI/AAAAAAAAC8c/QFKX9j41-aI/s1600-h/VotebyAge.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SKCkey_bLLI/AAAAAAAAC8c/QFKX9j41-aI/s400/VotebyAge.png" alt="" id="BLOGGER_PHOTO_ID_5233363615995342002" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The 20-somethings also shifted, from +2 for Gore to +9 for Kerry. Coupled with their surge in turnout, the younger voters kept Kerry close in 2004 when he was losing in every other age category. But it wasn't enough to win.<br /><br />The Obama campaign may be right that they can gain votes by mobilizing the young. But the old play a bigger role in elections, and they are not imovable in their vote preferences. Indeed, they make the youngest group seem a bit static by comparison. It is not the candidate's age that will be the key to winning the votes of those 60 and over. Issues and personality will play a large role. Any candidate would be well advised to recognize that the dynamic swings among older voters coupled with their substantial over-representation makes them a potent force for electoral change.<br /><br /><br /><br />P.S. <a href="http://www.pollster.com/blogs/age-turnout-and-voteshtml.php"> At the cross post to Pollster.com</a>, Michael McDonald noticed that my plots were based on population percentages rather than percentage of citizens. That's a good catch and I probably should have used citizens in the first place. But the qualitative results don't change at all, so my story remains exactly as it is above. The precise percentages quoted do shift a little bit, but not in ways that change any of the conclusions. Therefore I've left the text above as it was, but append the first three figures, revised to include only citizens, here for completeness. Thanks to Michael for pointing this out.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://1.bp.blogspot.com/_MRs_Nt465oE/SKD0eDz6RcI/AAAAAAAAC8k/5KVdNWsVTRk/s1600-h/Turnoutbyagecitizens.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://1.bp.blogspot.com/_MRs_Nt465oE/SKD0eDz6RcI/AAAAAAAAC8k/5KVdNWsVTRk/s400/Turnoutbyagecitizens.png" alt="" id="BLOGGER_PHOTO_ID_5233451564260804034" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SKD0eX60TLI/AAAAAAAAC8s/0XPJgiDy1M0/s1600-h/ShareofPopbyagecitizens.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SKD0eX60TLI/AAAAAAAAC8s/0XPJgiDy1M0/s400/ShareofPopbyagecitizens.png" alt="" id="BLOGGER_PHOTO_ID_5233451569658481842" border="0" /></a><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://4.bp.blogspot.com/_MRs_Nt465oE/SKD0ev3v4mI/AAAAAAAAC80/ppt795pGhpM/s1600-h/Representationbyagecitizens.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://4.bp.blogspot.com/_MRs_Nt465oE/SKD0ev3v4mI/AAAAAAAAC80/ppt795pGhpM/s400/Representationbyagecitizens.png" alt="" id="BLOGGER_PHOTO_ID_5233451576088060514" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-21915693479778828752008-08-04T15:08:00.003-05:002008-08-04T15:59:34.134-05:00Polling Trends in 2008 vs '04 and '00<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp3.blogger.com/_MRs_Nt465oE/SJdiCdwxsaI/AAAAAAAAC70/P763nTKcrkU/s1600-h/Pres08vs04aand000verlay.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp3.blogger.com/_MRs_Nt465oE/SJdiCdwxsaI/AAAAAAAAC70/P763nTKcrkU/s400/Pres08vs04aand000verlay.png" alt="" id="BLOGGER_PHOTO_ID_5230757286702592418" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The most common description of polls is that they are snapshots, not predictions. A good way to look at that in the 2008 election is to compare the '08 campaign with the two that came before.<br /><br />The chart above shows the trend estimates for each of the last three presidential campaigns. I'm plotting the estimated margin between the two candidates, Dem minus Rep, for each year.<br /><br />With 93 days to go until the 2008 election, Obama holds a 3.3 point advantage over McCain, though that has been eroding over the past six weeks. If we put a confidence interval around today's estimate, we get a race that is just barely leaning Democratic.<br /><br />But what about the future? The dynamics of the next 92 days are all important for where we stand on November 4. Since we can't foresee those 92 days yet, let's see what happened during the same time in 2000 and 2004. That gives us a better idea how much change we might anticipate in the next three months.<br /><br />In 2004, Kerry slowly built a 2 point lead by this time, and held a small lead through much of the summer. But then the race took a sharp turn, with Bush making a 6 point run, taking a four point lead with 50 days to go. Kerry gained back 3 points of that in the polling, but less than 2 points of it in the actual vote, losing by a 2.4 point margin.<br /><br />In 2000, Bush led in most of the early polls, holding a 6 point lead with 107 days to go. Then Gore moved sharply up, erasing Bush's lead and then adding a 3 point lead for Gore with about 56 days left. Bush promptly reversed Gore's gains with a six point move in the GOP's direction, and led by about 3 points over the last three weeks of the campaign. Of course, the 2000 polls were misleading in predicting a Bush win. Gore won the popular vote by 0.6 points.<br /><br />So far in 2008, Obama has enjoyed a run up of 5.5 points since his low point in late March. That run is on a par with Bush's in 2004 but still a bit less than Gore's 9 point run in 2000, and on par the Bush's 6 point rebound that year.<br /><br />Judging from the dynamics we've seen in the past it is quite reasonable to expect the current trend to shift by half-a-dozen points. August and the conventions have been periods of substantial change in both previous elections, so if history repeats itself the next 4 or 5 weeks should be pretty interesting.<br /><br />The bottom line is neither campaign should be complacent or despondent. There is a lot of time left and recent history shows that both up and down swings of 6-9 points are entirely plausible. <br /><br /><br />As a P.S. here are the three campaigns with educational confidence intervals around them.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp2.blogger.com/_MRs_Nt465oE/SJdiCj2rPaI/AAAAAAAAC78/MmOtScH4paU/s1600-h/Pres08vs04and00.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp2.blogger.com/_MRs_Nt465oE/SJdiCj2rPaI/AAAAAAAAC78/MmOtScH4paU/s400/Pres08vs04and00.png" alt="" id="BLOGGER_PHOTO_ID_5230757288337948066" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />The current 2008 estimate is just barely inside the "lean Dem" range, and will move to toss up if the current trend continues for another couple or three polls.<br /><br />The 2004 estimate was pretty close to the outcome which was well within the 68% confidence interval around the trend.<br /><br />The polls in 2000 were troubling for having the wrong popular vote winner, but even there the outcome was inside the 95% confidence interval. With races as close as the last two, it is worth appreciating just how wide those confidence intervals are.<br /><br />Our efforts to characterize races rely on the best estimates of those confidence intervals, but it is all too easy to focus on who's ahead and not remember how much uncertainty there is. That uncertainty is both about where the current estimate says the race stands today and about how the race may change in coming weeks. The data here show that unless one candidate builds a bigger lead than either has held so far, the uncertainty remains pretty big.<br /><br /><br />Note: My trend here is slightly different from the Pollster National trend because I'm working off the difference between candidates, not each trend separately, and because I've made 2008 comparable to 2000 and 2004, just a slightly different amount of smoothing compared to Pollster's standard estimator this year. None of those differences change the qualitative picture or shift the magnitude of changes I cite above.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-72008825550536766962008-06-13T11:15:00.005-05:002008-06-13T12:50:02.955-05:00Trends in Party Identification in Wisconsin<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp1.blogger.com/_MRs_Nt465oE/SFKuUSWMhhI/AAAAAAAAC7s/X45AEFFyHxM/s1600-h/PctPty.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp1.blogger.com/_MRs_Nt465oE/SFKuUSWMhhI/AAAAAAAAC7s/X45AEFFyHxM/s400/PctPty.png" alt="" id="BLOGGER_PHOTO_ID_5211419382366635538" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />This week my colleague Ken Goldstein and I conducted a Wisconsin statewide survey sponsored by the UW Department of Political Science and WisPolitics.com. So fair warning that I'm a party to this survey rather than an independent observer.<br /><br />A number of people have commented on the party identification balance in the survey: 38% Dem, 24% Rep, 29% Independent (37% Independent when "no preference/other" are allocated to independent. When this group is asked how they "lean", very few insist on some other party, so this allocation makes sense.) See <a href="http://courses.ttu.edu/hdfs3390-reifman/weighting.htm">Alan Reifman's blog on weighting and party id</a> for a good example and discussion of broader issues of weighting to party id.<br /><br />I want to point out two things here and put our data in the context of other polls in Wisconsin.<br /><br />The chart above shows party identification trends since 2000 using data from three sources that have done frequent polling in the state. What we see is a relatively stable Dem/Rep parity from 2000-2004, with Dem ID falling a bit around 2004 while Reps moved up slightly.<br /><br />Starting in 2005, however, there is an initially slow but then sharper shift in partisanship. Republican ID declines from about 30% to about 24% today, while Dem ID rises from about 30% to nearly 40%. After an initial surge of independents, that group has recently fallen off a bit. (You have to squint a bit to see WPRI and Badger after 2005, but they are close to the trend lines during this period, so the changes are not just a matter of house effects or phone vs ivr methods. WPRI, for example, has Rep ID moving from 33% in 2004 to 28%, 26% and 25% in 2005-2007. Their Dem ID rises from 30%-33%-34% then falls to 29% over the same period. The final 29% is a large discrepancy from the trend, of course.)<br /><br />We did not weight our survey to party identification, and these trends help explain why we have reservations about doing that. While relatively stable, party id does move over time, and by a fair bit, as you can see here. But that said, our unweighted results turn out to be quite close to the estimated trends in partisan categories in any case.<br /><br />The second point is to compare these trends with those in exit poll measures of party id. In 2000, the VNS Exit poll put Wisconsin pid at 37% Dem, 32% Rep and 31% Ind. This shifted in 2004 to 35% Dem, 27% Ind and 38% Rep. But in 2006 the exit polls found that the balance was 38% Dem, 34% Rep and 27% Ind. Those values all show a smaller share of independents at the polls on election day compared to the polling trend, but that is to be expected given differences in turnout between partisans and independents. The size of the party ID groups grows as a result, but the balance between them is in line with what we see in the trends in the polls, though certainly not an exact match. The polls, after all, are of either adults or likely voters, while the exits are by definition a measure of who actually showed up on election day. <br /><br />For 2006, the Dem exit percent and the Dem trend estimate are a close match. Republicans gain in the exits, by about 6 points over the 2006 trend estimate. If that holds for 2008, we might expect an electorate more like 38% Dem and 30% Rep. Of course both parties will have very active "ground games" and GOTV efforts to try to change those numbers.<br /><br />While I'm certainly happy that our party id balance is so close to the trend in all the other polling, the more important point is that party id in Wisconsin has shifted quite a bit over the past four years. The coming campaign may alter that, possibly bringing disappointed former Republicans back home, for example. Likewise a Republican advantage in turnout could bring the exit polls back to closer balance. But as the data show, today the GOP is at the worst disadvantage the state has seen in over eight years.<br /><br />Let me conclude with a bit of description of the polls used here.<br /><br />Wisconsin Policy Research Institute ("WPRI") has done some of the longest running polls in the state, usually two a year. Their data here is taken from their annual estimates, which I assume pool the two surveys though they don't say so explicitly. WPRI describes itself as "Wisconsin's Free Market Think Tank".<br /><br />The "Badger Poll" is conducted by the UW Survey Center. They did more extensive polling in 2002-04 but now do about two polls a year.<br /><br />SurveyUSA is a well known national pollster that uses "Interactive Voice Response" (IVR) automated interviews. SurveyUSA has done monthly polling in the state since 2005, providing some of the best data on state trends in approval of elected officials and as a byproduct have an excellent data series of party ID.<br /><br />Finally, there is our new Department of Political Science/WisPolitics poll. Ours uses a commercial call center, not the UW Survey Center or undergrads in a class calling for a grade. WPRI, Badger and our poll all use live interviewers, SurveyUSA uses IVR. Most of these surveys are in the 500-600 respondent range.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-82181137374588743652008-05-21T09:07:00.003-05:002008-05-21T12:27:29.471-05:00Gay Marriage Support and Opposition<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp0.blogger.com/_MRs_Nt465oE/SDQtKlKMOfI/AAAAAAAAC7M/C87DNk9qJ_M/s1600-h/GayMarryf2.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp0.blogger.com/_MRs_Nt465oE/SDQtKlKMOfI/AAAAAAAAC7M/C87DNk9qJ_M/s400/GayMarryf2.png" alt="" id="BLOGGER_PHOTO_ID_5202833129316563442" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Marriage for gay and lesbian couples has been a hot button issue, most especially so in the 2004 election cycle when 11 states considered and passed referendums banning (in various ways) same-sex marriages. In 2006 an additional 8 states voted on marriage ballot measures, with only Arizona defeating the proposal. In all, 41 states have statutes defining marriage as "between one man and one woman", and 27 states have put that definition into their constitutions. Only five states currently have no law banning same-sex unions (MA, NJ, NM, NY, RI). In 2008, Florida will have a "defense of marriage" amendment (DOMA) on the ballot, while California is awaiting certification of a ballot proposal and Arizona may reconsider its 2006 initiative (currently awaiting state Senate approval). (An excellent summary of the status of same-sex marriage in the states is <a href="http://www.ncsl.org/programs/cyf/samesex.htm">available here</a>.)<br /><br />Despite this overwhelming majority among other states, the California Supreme Court last week ruled that the state cannot constitutionally withhold the right to marriage from same-sex couples. (<a href="http://www.courtinfo.ca.gov/opinions/documents/S147999.PDF">Text of the ruling is here</a>. The LA Times initial report on the decision <a href="http://www.latimes.com/news/local/la-me-gaymarriage16-2008may16,0,6182317.story?page=1">is here</a>.) Supporters of gay marriage hailed the decision as a breakthrough for fundamental rights, in line with the same California Court's decision in 1948 striking down laws banning inter-racial marriage. Opponents of gay marriage argued the ruling puts the issue squarely back on the table for 2008 and confirmed the opponents argument that only constitutional amendments can prevent courts from overturning popular opinion on this issue. In 2000 California passed, by a 61%-39% majority, Proposition 22 affirming that "only marriage between a man and a woman is valid and recognized in California."<br /><br />California has one of the strongest domestic partnership laws in the nation, so the Court's decision has the effect of ruling that by withholding the designation "marriage", such domestic partnership laws still fall short of the equal treatment required by the state constitution.<br /><br />The California decision follows the Massachusetts Supreme Court's ruling of November 18, 2003 which ultimately made Massachusetts the first, and so far only, state to legalize same-sex marriage. (Rhode Island law recognizes same-sex marriages from other states.) Subsequently, the state Supreme Courts of New York, New Jersey and Washington have each declined to find a constitutional right to same sex marriage. Four states have civil union laws providing full state-level spousal rights (CT, NJ, NH and VT) while six have domestic partnership laws that provide varying degrees of spousal rights (DC, HI, ME, OR, WA plus the California law at issue in this decision).<br /><br />In light of the California decision, let's take a look at public opinion on same-sex marriage and how opinion has responded to past events.<br /><br />A typical question asks "Do you strongly favor, favor, oppose, or strongly oppose allowing gays and lesbians to marry legally?" (This is the form used by the Pew Research Center polls. There is considerable variation in question wording, but most polling has used a similar dichotomy between favoring gay marriage or opposing it. I've collapsed "degrees" of support or opposition into a dichotomous measure for all polls.) The earliest use of such a question I could find dates back to September 1985, but it was not until 1992 that the question began to be asked regularly. There was a flurry of interest in the question following the Massachusetts ruling and during the 2004 election campaign.<br /><br />If we rely on that first poll alone, in 1985 82% of the public opposed same sex marriage, while only 11% supported it. By the early 1990s, when the data become richer, opposition was at about 65% while support stood at about 28%. Congress passed, and President Clinton signed, the federal "Defense of Marriage Act" in September 1996, but public opinion trends seem not to have noticed at all, neither rising nor falling around that time. By the week of the California ruling, May 15, 2008, opposition had declined to about 55% while support had grown to 40%. The net effect of some 16 years of public debate was a 10 point decline in opposition and a 12 point rise in support.<br /><br />But that trend was not uniform. The Massachusetts ruling, and the 2004 election campaign, coincided with a sharp, if relatively short term, disruption of the previous slow but steady decade long shift of opinion. The Massachusetts Court decision placed the issue squarely on the public radar, and the 11 state ballot proposals in the 2004 election created the setting for public debate and political exploitation of the issue.<br /><br />During the year from November 2003 to November 2004, opposition to same-sex marriage rose by five points, from 55% to just over 60%. Meanwhile support fell by about eight points, from 38% to 30%, then rebounded by a point or so by election day. (These shifts slightly predate the Massachusetts decision, probably reflecting the increased visibility of the issue prior to the Court's ruling.) The impact of these shifts and of the 11 referendums that were passed on the presidential election remains debatable. Initial punditry credited the referenda with helping defeat John Kerry, especially in Ohio. More careful subsequent analysis doubts much of an effect, however.<br /><br />These sharp shifts in trend reversed direction immediately following the 2004 election, but took more than two years to return to pre-2004 levels. Support returned to 2003 levels in mid-2007 while opposition has only now, in May 2008, declined back to where it stood in mid-2003. Despite this slow recovery from the 2004 "shock", the 2005-08 trend lines make it clear that public opinion returned to its previous trajectory of slowly rising support and declining opposition in the aftermath of 2004. It is also interesting that the 2006 elections, with 8 states voting on referenda, made no discernible difference to the post-2004 trend. In part this may reflect the more limited number of states, but it also reflects some decline in the saliency of the marriage issue.<br /><br />The California ruling, and the likely campaign over a proposition there to modify the state constitution this fall, will test whether increasing the salience of the issue will result in a replay of the 2003-04 dynamics, with opponents stimulated and supporters in retreat, or if the 2006 experience means that the issue is no longer the motivator it was in 2004. The 2003-04 data clearly show the potential for sharp changes when the marriage issue becomes extremely salient. That the fight will take place in the most populous state in the Union also guarantees national exposure. However, the fact that most states have already settled this issue through law or amendment, and that only three states (so far) are on track to have proposals on the ballot, means that the issue is more localized than it was in 2004.<br /><br />Opinion now is not much different from where it was in mid-2003, so a similar reaction is possible but there may be an element of "been there, done that" as well. The novelty of the issue is surely much reduced now than it was five years ago, though the record of referenda passing in 7 of 8 states in 2006 certainly demonstrates that opposition to same-sex marriage remained strong even in a very pro-Democratic election year. (Wisconsin, for example, reelected a Democratic governor and flipped a House seat to the Democrats but also modified its constitution to ban same sex marriage or anything substantially equivalent to marriage.)<br /><br />The big question is whether the marriage issue has any carry over to the presidential vote in 2008. Democratic politicians, including Senators Clinton and Obama, have tried to insulate themselves by opposing gay marriage. Instead, they support civil union or domestic partner legislation. Senator McCain opposes same sex marriage and opposes legal recognition of same sex partnerships, but also opposes a federal constitutional amendment. This line of debate, with both parties opposing marriage, but with Democrats willing to support some legal recognition short of marriage, reflects another way to framing the question, one that is significantly more favorable for limited rights for gays and lesbians.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp1.blogger.com/_MRs_Nt465oE/SDQtK1KMOgI/AAAAAAAAC7U/0seSah4SQfw/s1600-h/GayMarryf3.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp1.blogger.com/_MRs_Nt465oE/SDQtK1KMOgI/AAAAAAAAC7U/0seSah4SQfw/s400/GayMarryf3.png" alt="" id="BLOGGER_PHOTO_ID_5202833133611530754" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><span style="font-size:85%;">(Note: This chart is scaled the same as the previous chart so the dynamics and time frame are directly comparable. The large white space prior to 2000 reflects the politically relevant point that in that time period the "civil union" option was not prominent enough to be included in polling questions.)</span><br /><br />Beginning in 2004 (with one early exception in 2000), polling organizations began asking a question with three alternatives. The CBS News question wording is representative:<br /><blockquote>Which comes closest to your view? Gay couples should be allowed to legally marry, or gay couples should be allowed to form civil unions but not legally marry, or there should be no legal recognition of a gay couple's relationship?</blockquote><br />When the "civil unions" option is added, opposition to gay rights drops significantly from about 55% to 40%. Likewise, support for gay marriage drops from 40% to 29%. The "comfortable" middle ground is then some 26% who are willing to support civil unions so long as they fall short of "marriage".<br /><br />This "half a loaf" approach is acceptable to only some in the gay rights community, but it is precisely the politically acceptable position that Democratic politicians think can move them from the losing side of public opinion to the winning side. If we add supporters of marriage to supporters of civil unions, we get the chart below.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp2.blogger.com/_MRs_Nt465oE/SDQtLFKMOhI/AAAAAAAAC7c/lVhNzPtb258/s1600-h/GayMarryf3mcu.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp2.blogger.com/_MRs_Nt465oE/SDQtLFKMOhI/AAAAAAAAC7c/lVhNzPtb258/s400/GayMarryf3mcu.png" alt="" id="BLOGGER_PHOTO_ID_5202833137906498066" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />This is now a near mirror image of the balance of opinion in the first chart. Now about 53% support either civil unions or marriage, and a minority of 40% oppose any legal rights for gay and lesbian couples. By assuming supporters of marriage will not punish them for the expedient support of only civil unions, Clinton and Obama (and many other Democrats) have tried to turn a losing position into a winning one. <br /><br />The remaining uncertainty is whether opponents of any legal recognition are more intense than the supporters of civil unions. If so, then opposition groups may still win the battle between intense minority and lukewarm majority. On ballot propositions, the record is strongly in favor of the opponents of marriage and in some cases of civil unions as well. <br /><br />The Clinton-Obama position will certainly not win over opponents of any form of legal recognition for gays, but then they probably wouldn't win many such voters in any case (an exception is African-Americans, many of whom are quite opposed to marriage or civil unions.) Whether their position provides them popular support in response to attack ads on this issue remains to be seen.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-35530012927337069342008-05-06T14:27:00.002-05:002008-05-06T14:33:55.430-05:00NC and IN Final Sensitivity Comparison<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp0.blogger.com/_MRs_Nt465oE/SCCxYIP26oI/AAAAAAAAC68/l43eBG7UBvs/s1600-h/NCSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp0.blogger.com/_MRs_Nt465oE/SCCxYIP26oI/AAAAAAAAC68/l43eBG7UBvs/s400/NCSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5197348998074526338" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Both standard and sensitive estimators are agreed in North Carolina. In Indiana there is a little bit of room between them, but not enough to affect conclusions about the probable outcome (if the polls are right!)<br /><br />The gyrations the Indiana sensitive estimator for Clinton goes through, thanks to variability in polls and relatively few polls, is a good warning that the sensitive estimator may just be a bit too ready to chase after noise.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp3.blogger.com/_MRs_Nt465oE/SCCxY4P26pI/AAAAAAAAC7E/T57vMIkj-WY/s1600-h/INSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp3.blogger.com/_MRs_Nt465oE/SCCxY4P26pI/AAAAAAAAC7E/T57vMIkj-WY/s400/INSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5197349010959428242" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-3577115409308336782008-05-06T14:07:00.004-05:002008-05-06T14:17:32.306-05:00NC and IN Final Pollster Comparisons<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp3.blogger.com/_MRs_Nt465oE/SCCti4P26mI/AAAAAAAAC6s/_Mtu7Hljx3Y/s1600-h/NCPrimaryPollsterCompare.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp3.blogger.com/_MRs_Nt465oE/SCCti4P26mI/AAAAAAAAC6s/_Mtu7Hljx3Y/s400/NCPrimaryPollsterCompare.png" alt="" id="BLOGGER_PHOTO_ID_5197344784711608930" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />With the last of the preelection polls in, we can now do our "apples to apples" comparison. Follow each pollster in the charts to see who's high, who's low and who has jumped around.<br /><br />Note this is for the Obama minus Clinton MARGIN (which makes it easier to plot all the polls in one, still jumbled, chart.)<br /><br />And check back tonight as the votes roll in to see who nailed it and who missed. In North Carolina all agree on the winner, only the margin is in dispute. But Indiana has a little disagreement on who is ahead. Fun!<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp0.blogger.com/_MRs_Nt465oE/SCCtjIP26nI/AAAAAAAAC60/z5jk8ctT7UU/s1600-h/INPrimaryPollsterCompare.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp0.blogger.com/_MRs_Nt465oE/SCCtjIP26nI/AAAAAAAAC60/z5jk8ctT7UU/s400/INPrimaryPollsterCompare.png" alt="" id="BLOGGER_PHOTO_ID_5197344789006576242" border="0" /></a>Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-79268983874524125622008-05-05T15:14:00.002-05:002008-05-05T17:10:40.454-05:00How much does the Pollster matter for Trend?<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp2.blogger.com/_MRs_Nt465oE/SB9sc4P26kI/AAAAAAAAC6c/kL8JSxHrzVg/s1600-h/NCPollEstWO.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp2.blogger.com/_MRs_Nt465oE/SB9sc4P26kI/AAAAAAAAC6c/kL8JSxHrzVg/s400/NCPollEstWO.png" alt="" id="BLOGGER_PHOTO_ID_5196991738399877698" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />One of the things we think about a lot at Pollster.com is the quality of polling. Mark Blumenthal's post on the North Carolina poll demographics <a href="http://www.pollster.com/blogs/the_demographics_of_the_indian.php">here</a> is a great example of how much variability we see among polls, all trying to hit the same target population.<br /><br />This issue is also raised by those who would like to exclude some polls from our trend estimates. If one "bad apple" spoils the barrel, then this is a serious issue for our efforts to estimate the state of the races here.<br /><br />We've stuck to our principle that we include all available polls without cherry picking (to shift the fruit metaphor!) but we don't do that out of blind faith. Rather we do it because the empirical evidence shows that the effects of single pollsters are generally small, certainly compared to the other sources of uncertainty about the state of the race.<br /><br />Here I take a look at this issue for North Carolina and Indiana.<br /><br />There are four elements that affect how much a pollster influences our trend estimate.<br /><br />First, the pollster's results must be "different" from the trend we'd estimate without them. If a pollster happened to hit our trend dead on every time, their influence would reinforce our trend estimate, but not change it. So for a poll to affect the trend, it needs to be different from what we'd otherwise estimate.<br /><br />Second, the pollster needs to produce results that are systematically different from the trend. If a pollster bounces around the trend, some high and some low, then the net effect is small, even if individual polls are rather far off the trend.<br /><br />Since the trend is determined across all pollsters, these first two points are another way of saying that the pollster must differ from what other pollsters are getting.<br /><br />Third, volume matters. In some states, a single pollster accounts for a substantial proportion of all polling, while other pollsters contribute only a single poll. The former obviously have more potential influence than the latter. But high volume of polls doesn't matter if they are consistently close to (and scattered around) the trend estimate based on other polling. The problem comes when the prolific pollster is also rather different from others, and especially if there are few other pollsters active in the state.<br /><br />Fourth, polls late in the game can have more leverage on the "current" trend estimate. So a pollster that does several polls but only in the last week before election day can have more influence on the current estimate than they would if those polls were spread over the entire pre-election period. Again, such an effect is only visible if the late polls are different from other polling.<br /><br />Having an effect on the trend could be a very good thing if the pollster is right while others are wrong. The problem is how do you know a priori which pollster will be right THIS TIME. Experience this year demonstrates that a good day can be followed by a bad day, or both on the same day.<br /><br />It is also important to put these effects in perspective across all polls we see in a race. The individual polls are highly variable. Our data often finds polls covering plus or minus 5, 6 or even 7 points of our estimated trend for an individual candidate, and double that for the margin between two candidates. There is a lot of noise out there, and the whole point of our trend estimator is to extract the signal from the noise. Our estimator (especially the "standard" estimator I'm using here, as opposed to the "sensitive" estimator we also check) is designed to resist polls that are "way off" (i.e. outliers) but at the same time be able to follow the common trend across polls. (I'm going to not go into the details of our local regression estimator here, which is not a simple rolling average. Let's hold that for another day. The FAQ on this is coming.)<br /><br />So let's take a look at the North Carolina plot way up there at the top of this post. The horizontal axis is scaled to show the range of poll results we've seen in the state since April 1. This provides perspective on how much variation you see from poll to poll in the raw results.<br /><br />The red "whiskers" at the bottom of the plot are the individual polls taken over this time. There is a bit more than a 25 point range in the Obama-Clinton margin during this period. Since the trends in the state have been relatively flat, only a little of this variation is due to "real change".<br /><br />Our trend estimate based on all polls is the vertical blue line, which as of Monday afternoon is +8.6 points in Obama's favor.<br /><br />How much do individual pollsters matter for this estimate? PPP has done the most polling in the state. If we take them out, the trend estimate drops to 7.0, a shift of 1.6 points on the difference (or an average of .8 points for each candidate, moving in opposite directions of course).<br /><br />At the opposite extreme, removing Insider Advantage from our estimator produces a 10.7 point Obama lead, a shift of 2.1 points on the difference, or 1.05 points per candidate.<br /><br />For most other pollsters, the effect is far smaller, even for relatively frequent pollsters such as SurveyUSA and ARG.<br /><br />So the maximum effect of removing a single pollster is a shift between a 7.0 and a 10.7 point Obama lead. A shift of 3.7 points on the difference can matter in a close race, but that difference is relatively small compared to the variation we see in individual polls. Indeed, the four polls completed 5/4 show a range of +3 to +10 for the Obama margin. (They average a +7.25, compared to our trend estimate of +8.6.)<br /><br />There is less polling in Indiana, so we might expect more influence since there are fewer polls to stabilize the trend estimator.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp3.blogger.com/_MRs_Nt465oE/SB9sdIP26lI/AAAAAAAAC6k/q4fg-GGCXCU/s1600-h/INPollEstWO.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp3.blogger.com/_MRs_Nt465oE/SB9sdIP26lI/AAAAAAAAC6k/q4fg-GGCXCU/s400/INPollEstWO.png" alt="" id="BLOGGER_PHOTO_ID_5196991742694845010" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />Here the current estimate using all polls is -6.2, a lead for Clinton. The range of results we get from excluding pollsters is from -4.1 (excluding SurveyUSA) to -8.7 (excluding Zogby). That is a bit larger than North Carolina, as expected. But put this in the perspective of the range of raw poll results for Indiana, which is from -16 to +5 in polls taken since April 1. The six latest polls as of Monday, all ending on 5/4, range from -12 to +2.<br /><br /><br />To sum up. Which polls we include affect our results. That both has to be and should be. We WANT the data to matter, and of course it does. What we don't want is for individual polls to make such large differences for our results that inclusion or exclusion decisions become critical. The results we see here show that we SHOULD be somewhat uncertain as to the trend, as it depends upon which individual pollsters are included. What is somewhat different in our approach at Pollster.com is we want to emphasize this uncertainty and put it in perspective, rather than produce a single number and treat that as if it were "certain". That is why we always show the individual polls spread around our trend estimate in the charts. All estimates have uncertainty. We need to understand both the value of the estimate and the uncertainty inherent in it. Pollster effects are part of that story.<br /><br />However, what is crucial is that these effects on the trend estimate are small compared to the range of variability we see across individual polls. The goal of our trend estimator is to produce a better estimate than what any single poll (or pollster) can provide. By that standard pollster effects on the trend are modest compared to the variability across individual polls.<br /><br />Evaluating the accuracy of the polls is a different topic, one we'll revisit again on Wednesday.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.comtag:blogger.com,1999:blog-16266256.post-26512251261615517492008-05-05T14:11:00.003-05:002008-05-05T14:27:45.587-05:00NC and IN Sensitivity Update<a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp2.blogger.com/_MRs_Nt465oE/SB9cM4P26iI/AAAAAAAAC6M/yTpHv0mKKqs/s1600-h/NCSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp2.blogger.com/_MRs_Nt465oE/SB9cM4P26iI/AAAAAAAAC6M/yTpHv0mKKqs/s400/NCSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5196973871335926306" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />As we close in on tomorrow's primaries in North Carolina and Indiana, the "standard" and "sensitive" trend estimates have largely converged.<br /><br />In North Carolina the standard estimator puts Obama at 50.1% and Clinton at 41.5%. The sensitive estimator has it Obama 49.5% and Clinton 42.2%. Or, a margin in the standard trend of +8.6 for Obama vs +7.3 in the sensitive estimate.<br /><br /><a onblur="try {parent.deselectBloggerImageGracefully();} catch(e) {}" href="http://bp3.blogger.com/_MRs_Nt465oE/SB9cNIP26jI/AAAAAAAAC6U/BSBXQgGLYJ0/s1600-h/INSensitivity.png"><img style="margin: 0pt 10px 10px 0pt; float: left; cursor: pointer;" src="http://bp3.blogger.com/_MRs_Nt465oE/SB9cNIP26jI/AAAAAAAAC6U/BSBXQgGLYJ0/s400/INSensitivity.png" alt="" id="BLOGGER_PHOTO_ID_5196973875630893618" border="0" /></a><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br /><br />In Indiana, the standard estimator puts Clinton up 49.5% to 43.3% for Obama. Switching to the sensitive estimator makes it Clinton 51.2% to Obama's 43.5%. Or a Clinton advantage of 6.2% for the standard estimator versus 7.7% for the sensitive one.<br /><br />Either way the polls are seeing a split decision tomorrow. Anything else will be a very interesting surprise.Charles Franklinhttp://www.blogger.com/profile/14359044151338650019noreply@blogger.com