Category Archive: Season 11

May 23 2012

That’s all for Season 11 (spoiler)

There you have it, folks. Phil, and conventional wisdom, wins, and Dialidol remains undefeated. Jessica’s fans did an admirable job tightening the race, but you can’t fight the entirety of the east coast with only two states. White guys with guitars is a monster to be slayed another day.

I still think that 60/40 was close to the right handicapping, but of course we’ll never know. Intrade had Phil at over 80% all day. Zabasearch and Votefair made a bad call, but that just shows that Idol prediction is a tough game.

We’ve had something like 40,000 page views this year, more than 10 times the traffic of last year. We were covered in at least two newspapers and several website articles. And I published a model that did … pretty lousy overall.

For regular readers, I hope that you’ve found my observations at least provocative, if not necessarily insightful. I’ve tried to be honest, thoughtful, and show the readers how I work through a problem.

This site is about to go totally dark, and no updates will be posted until next January. Feel free to hop over to my regular blog where I am running a web series on thermodynamics for non-scientists, Thermo for Normals. Follow Jessica at @jessicadennis and me at @schweinhundert on Twitter.

See you next year.

May 23 2012

The internet is underrating Jessica Sanchez’s chances

Right now many experts have selected Phil Phillips as the next American Idol. I’ve seen the sentiment expressed by MJ of mjsbigblog, by IdolBlogLive, by at least one member of each of the Idol Radio Show and FarmvilleRant Radio. And, of course, Dialidol. Intrade still has Phil at 80%.

I am not longer convinced that it should be nearly as high.

Yes, Dialidol has never been wrong about a finale. But I agree with what people have said: Dialidol has underestimated the Hawaii vote. I also think that within the margin of error, there’s a very good possibility that Dialidol has gotten lucky on the two calls that they’ve made where it wasn’t a landslide.

In short, I think I’m saying that it’s close to even odds. Anybody saying otherwise is being overconfident in Phil’s chances, perhaps specifically because of Dialidol.

Zabasearch, which does not have great accuracy this year but is OK, has projected Jessica to win. I have no idea how close it was, so I have no idea how confident to be in their results. But as one more indicator, it pushes the needle away from Phil at least a little bit, doesn’t it?

80% is too high for Phil. Maybe Phil has a 60% chance, and no more. The internet pundits seem to be 100% behind Phil, and I think that’s kind of crazy.

May 23 2012

Too close to call

Jessica Sanchez’s fans failed to pull her ahead in Dialidol, as her support petered out at about 3:30 AM eastern time last night:

They did, however, pull her much closer to even with Phil than at the beginning of the night. As such, there is no official Dialidol call, because the difference between the two is within the margin of error. Also note that I believe (not sure) that Dialidol should have left the poll open for another hour. However, at the rate measured at 4:00 AM, that would not have changed the fact that Phil would be on top.

Some people think that Phil being ahead on Dialidol is dispositive, but I’m not so sure. We saw just last week that Jessica’s votes were at least slightly undercounted compared with Joshua’s. The question is how big this effect is. We know that she’s being undercounted by at least 0.3 points. But could she be undercounted by 1.4? We don’t really know, but it could be.

Much has been made of Dialidol’s accuracy, but many of their calls are outside the margin of error. 2 out of 7 were too close to call. Yes, Dialidol ranked the winner #1 in both of those cases, but they had a 1 in 4 chance of that happening by random guess.

Meanwhile, Intrade’s estimate for Phil winning dropped from 90% to 80%, which is where I thought it ought to be. Also, you can read Votefair’s official explanation for why it’s OK that Jessica has led every poll for the year. I’m not sure I find it entirely convincing. He says that he is controlling for votes from the Philippines. But what about votes from Asian Americans? It’s not like he can IP filter those. Votefair is a self-selecting poll, and there are lots of potential problems with that.

I still lean toward Phil being the winner, but there isn’t enough information right now.

May 23 2012

Jessica may be closing the gap

UPDATE 2: Ok, I am going to bed. This is ridiculous. According to my projection, Jessica will overtake Phil in about an hour, 4:30 AM eastern. If that happens, well, you’re going to see a post here tomorrow morning that says I think Jessica Sanchez will win.

UPDATE: The effect is accelerating for Jessica Sanchez. To look at this, it appears that she will overtake Phil Phillips before the voting closes. Wow. I’ve updated the graph from my original post to reflect the change.

Original post: In between about 1 and 2 am tonight, the gap between Phil and Jessica on Dialidol narrowed from 16.477/11.431 to 16.119/11.543, or a change of about half a point. Looking at the DIHardGraphs, Jessica’s voters might be doing it.

(Times are all eastern time zone, times beyond 2:30 AM are projected by me) If Jessica can maintain the pace (that is a big if), her supporters can barely squeak her into the lead by the time Hawaii’s voting closes, I think. Now, if a majority of those votes come from California, it won’t happen, because their voting will close off. But if more from Hawaii replace them, they might be able to squeak by.

May 23 2012

Finale performance show impressions

The early returns from WNTS have been posted, and the contestants had an average score that was equal to within a rounding error (53). The proprietors over there say that it was neck-and-neck, but that the performances were perfunctory because people have already made up their minds.

Fair enough, that might be. But if anybody was going to be swayed, I do not think it would be in Jessica’s direction. Her rendition of the truly execrable Idol song “Change Nothing” scored a 26, tied for 6th worst of any performance during a finale. Phil’s version of “Stand By Me” was also panned, but does not rank in the top 10 worst finale performance polled by that service. With near-rave reviews of his Idol song, Phil would perhaps be at an advantage if any was to be had.

Dialidol, which I’ll remind you has not yet missed a call in 7 years of finales, has Jessica trailing badly in all metrics (Dialidol score, raw votes, and busy signals). As of right now, she’s being trounced. California can help her, but they will need to get busy. She may pick up some of Joshua’s votes, but there is no evidence that she has so far. The current slope in the DIHardGraphs show no flagging of Phil’s support. The voting closes at 1am on the east coast, so maybe after that she can pick up some steam.

Intrade, the betting market where people buy and sell “stock” in a given outcome, has Phil at a 90% probability of winning. That is the same probability they had Barack Obama at on Nov 3, 2008, an election whose outcome was more or less assumed. I happen to think that giving Jessica only a 10% chance is a bit low. My feeling is that it’s more like 80% to 20% in Phil’s favor.

Finally, what will we make of Votefair’s result? Currently Jessica is winning on that service 70% to 30%. It might seem compelling that she has 2.3 times as many votes as Phil, except for one little problem:

Choice Vote count Percentage
Jessica Sanchez 414 39
Phillip Phillips 159 15
Colton Dixon 141 13
Elise Testone 92 9
Hollie Cavanagh 86 8
Skylar Laine 82 8
Joshua Ledet 76 7

That’s Votefair’s results for the Top 7. She had 2.6 times as many votes as Phil that week on Votefair. You know who actually had more votes than Jessica? Phil, Joshua, Skylar, Colton, Hollie, and yes, even Elise. She was dead last.

What would be the point of crunching numbers? There isn’t currently any single substantive reason to think that Phil will not win. Squinting at data trying to see a given result is something that we’ve all been guilty of, but no amount of squinting is going to reveal a probable Jessica win. It would be a major upset, though I might stop short of saying a shocking upset.

Yes, upsets happen. The US beat the Russians in hockey at the 1980 Winter Olympics. Buster Douglas beat Mike Tyson. The Patriots beat the Rams after bringing a 6th round draft pick as their quarterback mid-season. Anything can happen, I suppose. But this isn’t where the smart money is.

May 22 2012

How the model works (and doesn’t work): Part 2

This is a continuation of a thorough explanation of the forecasting model I’ve used. The present article is a wrap-up of the season and an assessment of the model’s accuracy. Please see Part 1 of this series for a somewhat detailed explanation of the analytical model.

Overview

Most people’s perception of the model this season is that it’s really terrible, but in fact it made a ton of very good calls early on in the season. Many people did not start reading this blog until later, when its foibles became more evident. The semi-finals, Top 13, and Top 11 went swimmingly. It had great accuracy. Then the wheels came off.

Of the 13 lowest-vote getters, 6 of them were either the bottom contestant or the next-to-bottom contestant in the model:

Read the rest of this entry »

May 18 2012

Jessica Sanchez vs. Phil Phillips

Phil vs Jessica. These two contestants could hardly be more different.

Phillip Phillips has many traits that make him the favorite to win. He was featured in the auditions a lot, with a total pre-exposure time of more than 1000 seconds, and with his initial audition having been shown in-episode and in promos. He’s white, male, plays guitar, and sings mostly songs that are new to Idol. Compare that to winners past, and you check off a lot of boxes:

Contestant Season Sex Race Age
at start
Hometown Avg Of
WNTS Rating
New
songs
Bottom
2/3 ever?
Kelly Clarkson 1 F White 20 Burleson, TX 76.8 11 No
Ruben Studdard 2 M Black 24 Birmingham, AL 63.6 16 Yes (Top 5)
Fantasia Barrino 3 F Black 19 High Point, NC 65.4 10 Yes (twice)
Carrie Underwood 4 F White 21 Checotah, OK 57.3 15 No
Taylor Hicks 5 M White 29 Birmingham, AL 61.3 10 No
Jordin Sparks 6 F Black 17 Glendale, AZ 59.6 11 No
David Cook 7 M White 25 Blue Springs, MO 64.7 15 No
Kris Allen 8 M White 23 Conway, AR 61.1 7 Yes (Top 5)
Lee DeWyze 9 M White 23 Mount Prospect, IL 57.8 9 No
Scotty McCreery 10 M White 17 Garner, NC 52.5 13 No

Here are the stats for the finalists this year:

Contestant Sex Race Age
at start
Hometown Avg Of
WNTS Rating
New
songs
Bottom
2/3 ever?
Phillip Phillips M White 21 Leesburg, GA 54.1 11 No
Jessica Sanchez F Asian/
Hispanic
16 San Diego, CA 66.6 6 Yes (Top 7,
Saved)

The mean age of winners is 21.8 years, and Phil is 21. Phil was never in the Bottom Group, just like 7/10 of his predecessors. All winners except Lee DeWyze and Jordin Sparks hailed from the South or Midwest United States, and Phil is from Georgia.

On the flip side you have Jessica Sanchez. She had significantly less pre-exposure (600 seconds), with her audition never having been shown. She’s non-white (mixed race, if I’m not mistaken), female, has never played an instrument on stage, sings mostly songs that have been sung on Idol before. If she were to win, she would be the youngest ever, at 16. She was the bottom-vote-getter in the Top 7 and had to be saved. She is from California, which has not yet produced a winner.

So, on a purely demographic and historical basis, she would appear to be the underdog.

What can we put in Jessica’s column that favors her? Her approval rating, as computed by WNTS, is significantly higher than Phil’s, at about 67, much more in line with previous winners. She has four performances rated higher than 80 on WNTS (Love You I Do, And I Am Telling You I’m Not Going, I Will Always Love You, and Sweet Dreams), whereas Phil has only one (Volcano). The only contestants to win with as few as Phil has were Lee DeWyze (1 song over 80) and Scotty McCreery (0 songs over 80), so in this respect Jessica has the edge.

There is the matter that Jessica has a large following specifically because of her racial identity. Looking at Dialidol’s Geopredictions, Phil and Joshua barely registered any votes at all in Hawaii, a state with a large population of Filipinos. However, relying on that did not work out so well for Jasmine Trias, Camile Velasco, or Jonah Moananu.

As I said in an earlier post, I think Jessica can certainly win, but probably won’t. In light of the evidence above, I think you might agree that her odds hover somewhere around 2:1. But that’s enough of a margin that if she really kills it, she could take the title. This may be the first Finale since season 8 that actually mattered, and as such I think we can say that it’s been an entertaining year, despite the producer’s fumbles and the egregious judging.

May 17 2012

Quick note about tonight’s result (spoilers)

Spoiler alert!
Read the rest of this entry »

May 17 2012

Top 3 final prediction

There is no direct historical precedent for this week. Jessica Sanchez has pulled nearly even with Joshua Ledet on Dialidol overnight, indicating that there were perhaps a ton of votes for her on the west coast*. She still barely trails Joshua In order to get around this, we could force both Jessica and Joshua to be second on Dialidol, which produces the following standings:

Contestant WNTS Rating (avg.) Dialidol Rank Bottom 3 Previously? Previous Rating Probability of
Elimination (%)
Jessica Sanchez 45.7 2 Yes 74.5 45.8
Joshua Ledet 54.7 2 Yes 69.0 31.7
Phillip Phillips 61.0 1 No 63.5 22.4

The closest possible analog for this week is Season 5, where Elliott Yamin trailed Katharine McPhee by 0.5 points on the Dialidol scale. He was eliminated. In Season 8, Danny Gokey trailed Kris Allen by 0.89 on Dialidol, and was eliminated.

Take it for what it’s worth, but the official call is Jessica Sanchez will be eliminated.

If you’re wondering how Phil’s chances have gone up, the reason is that the standings have to be normalized to 100%. If any of the contestants has their elimination probability drastically reduced, people with lower probabilities have theirs increased. I don’t think Phil is actually at risk.

*Originally this post stated that Hawaii’s votes are included in Dialidol numbers. Reader John Santos has pointed out that Dialidol closes off its voting after the Pacific time voting elapses. I still think that votes from Hawaii are important for Jessica, but not necessarily to the Dialidol figure.

May 17 2012

Top 3 preliminary prediction

Note: These numbers are preliminary. I will update in the morning.

Contestant WNTS Rating (avg.) Dialidol Rank Bottom 3 Previously? Previous Rating Probability of
Elimination (%)
Jessica Sanchez 45.7 3 Yes 74.5 71.54
Joshua Ledet 54.7 2 Yes 69.0 26.18
Phillip Phillips 61.0 1 No 63.5 2.28

The west coast is going to determine how this works out tonight.

As of 12:40 EDT, Jessica Sanchez is trailing Joshua Ledet on Dialidol, and it’s not particularly close. Dialidol has predicted the outcome of the Top 3 wrong only once.

That being said, Jessica’s base is in the west coast. If Californians and Hawaiians succeed in pushing her over Joshua, her elimination chances will drop to only 37%, whereas Joshua’s will skyrocket to 87%.

Honestly, the approval ratings calculated by WNTS during the Top 3 have proven to be totally meaningless to the outcome of this round. There is barely any evidence in the data that it even matters. If American Idol is a popularity contest, that really starts to show in the Top 3.

Although I do not take into account VoteFair in the quantitative model, they have been quite good this year, with a 36% accuracy in projecting eliminated contestants and 67% accuracy in guessing the Bottom 3. However, they did not correctly predict that Jessica was the bottom-vote-getter in the Top 7, because Jessica Sanchez has led every single vote on VoteFair ballot the entire year! That is, Votefair is seemingly not capturing the voting on that, and some have attributed that to a large group of Filipinos stuffing the ballot box. This is plausible, so I would take Votefair’s projection with a grain of salt this week.

If Jessica is still last on Dialidol when I wake up in the morning, it looks like we’re having an all-male finale.

Older posts «