Category Archive: Predictions

May 15 2013

Top 2 prediction (updated)

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe
Probability
Kree Harrison Angel /
All Cried Out /
Up To The Mountain
59.667 9.287 42 0.758
Candice Glover Chasing Pavements /
I Am Beautiful /
I (Who Have Nothing)
64 14.735 58 0.242

Updated 10:54 AM EST. Candice has expanded her lead on Dialidol, and is now called by that service as well, outside the margin of error. Dialidol tends to be cautious when it calls a contest, so this is looking better for Candice.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 3 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

The model predicts Candice Glover will win season 12 of American Idol.

Candice is currently sweeping all major indices, and while the numbers may flit a little this way and that, unless Kree can actually switch one of them, she is unlikely to win. Mostly, though, this comes down to Dialidol, and that measurement shows Candice winning by a large margin. Without some kind of west coast surge, there’s no way I can see to do it.

Of course, Kree could win, but it would be a major upset. Candice is about 3 times likelier to take the title, at least as far as the model can tell. Note that until the model is wrong about a finale, there is some uncertainty as to its ratings (as perverse as that may sound).

You can see how the model rated past finale rounds to see if they match your gut about how those years ran. To me they fit pretty good. And based on what I saw, and based on the huge amount of high-rated performances (as rated by WNTS) that Candice has had, she looks more like a winner than Kree does (from a numerical point of view).

It’s not in the bag, but it looks good for Candice fans.


Reuben is the statistician and lead writer at IdolAnalytics. Follow him on Twitter. His personal site (run all year round) is IdleAnalytics
.

May 15 2013

Prediction coming soon, but Candice is already way ahead

The official model call will be posted as soon as WNTS ratings are posted, but those don’t matter all that much at this stage. Candice is handily beating Kree on both Dialidol and Votefair, and that by itself is enough to put her at a 75% chance to win, versus only 25% for Kree. If WNTS ratings come in like I think they will, it will be a clean sweep. Check back for the official numbers after Dialidol equilibrates a little, but I have Candice at about 1:3 odds at present.

May 09 2013

Top 3 prediction

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe
Probability
Angie Miller Sorry Seems to be the Hardest Word/
Try/Maybe
57.333 3.799 45 0.382
Candice Glover One/Next To Me/
Somewhere
64.333 6.581 34 0.309
Kree Harrison Perfect/
Here Comes Goodbye/
Better Dig Two
49 8.664 20 0.309

Updated 11:35 AM EST. No change in ranking.

Update: NB: If you read the post below you’ll see that this year will be the second closest Top 3 in the model’s history. The only one more competitive was Elliott Yamin vs Katharine McPhee. Quite close contest this year.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 3 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Names in green are predicted safe. Names in red are the most likely bottom 3. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable eliminated contestant is Angie, though none of these would be shocking.

DialIdol had a miserable failure last week, which is unusual. Typically, that index becomes more accurate as time goes by, and by the Top 4 one shouldn’t take its pronouncement lightly. Given that, Angie seems to be in trouble. As to this (official) projection, Angie had a poor Dialidol score and was in the middle on WNTS, and is thus the most likely to be eliminated based on historical factors. I would note that these numbers are fairly close to one another, and so this represents something close to a three-way tie.

However, if you are skeptical as to this call (as am I), then perhaps you will be more interested in the following “Dialidol is full of crap” projection:

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe
Probability
Kree Harrison Perfect/
Here Comes Goodbye/
Better Dig Two
49 8.664 21 0.504
Candice Glover One/Next To Me/Somewhere 64.333 6.581 32 0.313
Angie Miller Sorry Seems to be the Hardest Word/
Try/Maybe
57.333 3.799 47 0.183

This is obviously not the official model call, but it may match your gut more than the official one does, as it certainly does mine. The Top 3 Tracker had Kree in third place all year with the exception of one week. Given the accuracy of the T3T, I tend to think Kree is heading home.

Nonetheless, the official call is Angie as of this writing.


Reuben is the statistician and lead writer at IdolAnalytics. Follow him on Twitter. His personal site (run all year round) is IdleAnalytics
.

May 08 2013

How the model saw past Top 3 rounds

Tomorrow night I’ll post a forecast on the Top 3, and you may want to know how the model that the forecast is based on “saw” the past Top 3 rounds. Indeed, the model was potentially misleading in this year’s Top 4 (though the Top 3 Tracker was pretty good all year) by seeing Candice as the most likely. Of course, for all we know she was second-to-last, but it is peculiar that the person it saw as the most likely was safe and the person it saw as least likely was eliminated. In any case, take this historical information and make of the model’s prediction what you like. Read the rest of this entry »

May 02 2013

Top 4 redux prediction (final)

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe
Probability
Candice Glover When I Was Your Man/
You’ve Changed
73 3.816 22 0.565
Kree Harrison See You Again/
Stormy Weather
57 4.837 26 0.485
Angie Miller Diamonds/
Someone To Watch Over Me
49 2.944 44 0.479
Amber Holcomb Just Give Me A Reason/
My Funny Valentine
41.5 7.175 9 0.472

Final update 2:50 PM EST. No ranking changes.

Updated 10:46 AM EST. Angie gained a bit, and Kree fell, so they swapped positions.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 2 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Names in green are predicted safe. Names in red are the most likely bottom 2. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable bottom 2 is Candice and Angie Kree. However, anybody on the list being in the bottom 2 would not be shocking. [updated: Angie no longer 2nd most probable, Kree is. It's still basically a tie.]

Sorry to do this folks, but there’s no firm prediction possible based on the preliminary numbers. Amber, Kree, and Angie are running what amounts to a dead heat as far as the model can tell, and so it can’t make any safe calls. Nobody is far-and-away winning this race.

However, for the second week in a row, the model thinks Candice is the most at risk of elimination. She was in the bottom 2 last week, so I can certainly see it happening. Amber would be the one my gut would pick, but the model chooses her as the least likely, mainly on the strength of her Dialidol number, which is significant. If you’ve read the methodology post, you know that Dialidol becomes a stronger indicator as the year goes on, whereas WNTS and Votefair become less predictive with each passing week.

As perverse as it might seem, this prediction is independent of the Top 3 Tracker, which takes a longer view of the season. In a sense, the T3T is not sensitive to week-to-week shocks. As such, it would say that Amber is gone. However, based just on tonight’s numbers, Candice is.

Note that I haven’t a clue how I would take into account the two weeks’ votes being pooled. These numbers are based purely on tonight; since Candice was the highest probability in both weeks, that’s unambiguous that she would be the most likely.

Two things to ponder. 1. Amber was first on Dialidol last week and this week, and was nonetheless in the bottom 2 last week. 2. Angie was last third on Dialidol last week, but we know she was in the top 2. If Dialidol is very different from previous years, of course, the model will be way off. However, the model was correct in calling Angie safe last week, so the other factors do matter. Take it for what it’s worth.

Apr 28 2013

Top 3 tracker gets a one week extension! Because Idol can’t plan!

So now we have our answer for how the producers plan to fill their schedule. Another Top 4 means that the Top 3 Tracker sticks around for one more week, though there isn’t much change. Amber fell a little bit and Angie rose.

In lieu of a post-game post this week, let’s contemplate what the data doesn’t say. Did Kree benefit from Janelle’s voters after she was eliminated? There’s no real good way to know this. We could look at Votefair’s results, which show which people preferred whom. However, this isn’t scientific, since people decide whether to answer Votefair’s survey. Moreover, the sample size changed by a large amount. Nevertheless, purely out of curiousity, let’s look at what the change in preference were from the previous week assuming the same people voted on the site both weeks:

Switched from %
Candice to Angie 14
Kree to Candice 2
Candice to Amber 7
Kree to Angie 14
Amber to Angie 20
Kree to Amber 8

Kree lost preference in all her pairings. So where did the extra votes come from to keep her in the top 2? Did they come from Janelle’s voters? Plausible. There’s no way to quantify it, of course, but it’s obviously common sense that if there are two country contestants, and one gets booted, the remaining one will pick up votes.

Top 3 Tracker as of 4/27/2013. Hover your cursor for more info.

Apr 25 2013

Top 4 prediction (final)

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe
Probability
Candice Glover Find Your Love/
Emotion
58 4.667 18 0.577
Kree Harrison It Hurts So Bad/
A White Shade of Pale
50.5 4.053 27 0.560
Amber Holcomb The Power of Love/
MacArthur Park
41 6.218 10 0.507
Angie Miller Who You Are/
Cry Me A River
70 4.448 46 0.357

Final update 4:04PM EST.

Updated 8:16AM EST: Some pretty big movement overnight. Candice is still the most likely, but Kree moved into danger and Amber moved into uncertain territory.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 2 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Names in green are predicted safe. Names in red are the most likely bottom 3. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable bottom 2 is Candice and Amber. However, anybody on the list being in the bottom 2 would not be shocking.

Original post:

I know, I know, I don’t believe it either.

What events would conspire to convince the model that Candice could possibly be in jeopardy? She had a high performance approval, and decent Dialidol numbers. But while Amber and Kree had sagging numbers on at least one index, they also have an indicator of strength in another. Kree had a bad Dialidol score, but is quite popular on the voting on Votefair. Amber has very low popularity on Votefair, and quite bad performance approval, but had the highest Dialidol score.

Candice and Amber are basically in a tie, but it would be strange if Kree were not voted off, no? She was in the bottom group last week and got what passes for bad reviews tonight from the judges. Nevertheless, history would dictate that Kree is safe. If Votefair readjusts by tomorrow, this could change, of course, so I will update. [Amber gained overnight, and is now ahead of Candice by about 7 points]

Angie continues to look like the front runner. She topped two indices, though she was third in Dialidol. I’m not clear on why her numbers are sagging on Dialidol, but the model hedges against that index even at this point in the contest.

Apr 18 2013

Top 5 prediction (final)

Name Song WNTS (avg.) DialIdol VoteFair Not-safe Probability
Janelle Arthur When I Call Your Name/
Dumb Blonde
38 0.636 5 0.633
Amber Holcomb Without You/
What Are You Doing The Rest of Your Life?
55.5 6.143 9 0.401
Kree Harrison She Talks To Angels/
Have You Ever Been In Love?
65.5 3.614 18 0.376
Candice Glover Straight Up/
When You Believe
69.5 1.135 28 0.347
Angie Miller I’ll Stand by You/
Halo
62 1.934 40 0.244

Final update: no change in calls.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 3 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Names in green are predicted safe. Names in red are the most likely bottom 2. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable bottom 2 is . However, anybody on the list being in the bottom 2 would not be shocking.

There seems to be the sentiment that the save will definitely be used tomorrow, and now that I see that the finale is scheduled for May 15, I suppose that’s probably true. That would mean this week is a bye, and that’s just a shame. I don’t know that a week where there’s no possibility of elimination is likely to draw too much attention.

For whatever they’re worth, there are no surprises in the above numbers, as they are consistent with what’s been happening the whole time. Janelle was pretty much declared the one the judges want to be voted off (or saved, as the case may be). Kree Harrison is not safe within the margin of error, so there could be a surprise there, but I wouldn’t bet on it.

Candice may gain ground by tomorrow afternoon, as she did last week, and overtake Angie as the least likely to be in the bottom 2, but she didn’t have nearly the standout performance that she did last week, and Angie somewhat bounced back from a 3 week slump.

I’m a bit surprised by Amber’s standing on Dialidol. Just last week she was dead last on that service’s prediction, and tonight she’s way out in front, something that I find weird but possible.

Apr 11 2013

Top 6 prediction (final)

Name Song WNTS
(avg.)
DialIdol VoteFair Not-safe Probability
Janelle Arthur I’ll Never Fall in Love Again/
The Dance
45 0.957 7 0.570
Lazaro Arbos Close to You/
Angels
7.5 3.519 7 0.467
Amber Holcomb I Say A Little Prayer/
Love On Top
55 2.492 10 0.433
Kree Harrison What the World Needs Now/
Help Me Make it Through the Night
70 2.951 20 0.244
Angie Miller Anyone who had a Heart/
Love Came Down
47.5 2.559 28 0.166
Candice Glover Don’t Make Me Over/
Lovesong
90 4.623 28 0.119

(Final update 3:19PM EST)
(Updated 10:48 EST)

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 3 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Update: No change in the calls. However, for the first time, Angie is not the least likely to be not-safe, based on Candice’s huge rise.

Original post:

Names in green are predicted safe. Names in red are the most likely bottom 2. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable bottom 2 is Janelle and Lazaro, However, anybody on the list being in the bottom 2 would not be shocking.

Dialidol shows Lazaro pulling second place, and at this stage of the contest it’s not a good idea to ignore Dialidol. This by itself isn’t enough to say Lazaro is doing fine. In fact, his other numbers are terrible. But considering historical factors, he’s not the most likely to be voted off.

That honor goes to Janelle, I’m afraid, and by quite a large margin. This would not be surprising, absent Lazaro’s performance tonight, since Janelle has twice found herself in the bottom group, and Lazaro only once. I don’t feel like the judges gave enough of a full-throated denouncement of Lazaro, but even if they had he appears to have some rabid voters on his side.

Factoring in the margin of error, in fact, the model can’t really decide between Lazaro and Amber as being in the bottom group.

I pray the most likely to be voted off isn’t. There’s still a good probability Lazaro is gone. It’s just not something I would necessarily count on.

I have no idea what has made the staff at WhatNotToSing this damned irascible. They are so bothered by this season that they’re threatening to quit Idol statistics altogether. Maybe they’re going just on the numbers, but I recently watched season 2 again for an upcoming retrospective video, and this season is way better than that. If that site does indeed choose to stop collecting their statistics, I will have to find some alternative for judging performance quality. It seems a peculiar fit of pique over what is at worst an average season.

Apr 04 2013

Top 7 prediction (final)

Name Song WNTS DialIdol VoteFair Not-safe Probability
Burnell Taylor You Give Love A Bad Name 28 0 1 0.725
Lazaro Arbos We Are the Champions 20 1.065 3 0.658
Janelle Arthur You May Be Right 55 0.527 10 0.491
Candice Glover (I Can’t Get No) Satisfaction 65 0.885 18 0.340
Amber Holcomb What About Love 67 2.224 16 0.335
Kree Harrison Piece of My Heart 52 1.465 20 0.313
Angie Miller Bring Me To Life 71 4.208 32 0.138

Final update 2:35 PM. No change in ranking of the bottom 3, but Candice dropped a little relative to Amber. They’re basically neck-and-neck.

Updated 9:49 AM. Final update probably around 2pm since I have a job. There were no changes in the ranking from the update.

Important!

The methodology for the finals model is described here. The model is 87% accurate on ranking within a margin of error of +/- 3%. Probabilities being what they are, somebody with a not-safe probability of just 0.25 will be in the bottom 3 one out of four times. Please do not comment that the numbers are wrong. They are probabilities, not certainties or even claims. Do not gamble based on these numbers.

Names in green are predicted safe. Names in red are the most likely bottom 3. Names in yellow are undecided. Any person not in green is not considered safe by the model. The most probable bottom 3 is Burnell, Lazaro, and Janelle. However, anybody on the list being in the bottom 3 would not be shocking.

The Idol Analytics model was sort of devised to be in line with how I think Idol works. But I’m beginning to think maybe it’s a little too representative of that this year.

In any case, there are no surprises in this listing. Janelle has been considered the weakest girl, though she never has been in the Bottom 3, so the model could (of course) be wrong. All predictions are beyond the margin of error at 87% confidence. Burnell and Lazaro are predicted not-safe at the 95% confidence range.

Dialidol looks to be having a lot of volatility. I watched Candice go from #1 to #4 in a span of about 20 minutes tonight. I don’t really know how to account for that (since, I confess, the Dialidol weighing algorithm is a bit opaque to me).

I never have put a lot of stock into the idea that certain songs or even artists determine the disposition of a contestant, but for what it’s worth I’ve compared the song selections tonight to the song choice indices I’ve developed here and here. Candice and Kree made choices that were above average (both for song and artist), and Amber made bad to mediocre picks. Janelle and Lazaro picked below average artists to cover, though their actual songs were not common enough to rank. No data is available for the other picks.

WhatNotToSing has an editorial up arguing that the judges’ save has to be used tomorrow … or it doesn’t. Their reasoning goes that the judges will never go a season without using the save, and since next week is the last possible round to do so, anybody next week will know that nothing counts. This is not convincing at all to me, though your opinion may differ. I think it’s easily possible the save will not be used this year.

Older posts «