Analyst: Metacritic scores don't drive success
The idea that review scores don't matter is nothing new around Joystiq. We've seen the argument made by EEDAR's Jesse Divnich, specifically in reference to DS games. Michael Pachter and Peter Moore have leveled the same claim at Wii games as well. Now, Cowen Group's Doug Creutz tells Gamasutra that the score generated by aggregators like Metacritic is the least important factor in how well a game performs.
Creutz notes that scores can be "somewhat predictive" of a game's success, but are "unlikely in and of themselves to drive or undermine the success of a game." He then mentions the industry scuttlebutt that many publishers work very hard to jockey scores, saying that publishers' time would be better spent on development instead of "grade-grubbing."
The major factors in purchasing decisions, according to Creutz, are genre, whether a player liked the previous game in a series and, unsurprisingly, price. So there you have it publishers, to be successful, all you have to do is make a sequel to a popular game in a genre that a lot of people like. And make it cheap. If that's not possible, two out of three ain't bad.
Creutz notes that scores can be "somewhat predictive" of a game's success, but are "unlikely in and of themselves to drive or undermine the success of a game." He then mentions the industry scuttlebutt that many publishers work very hard to jockey scores, saying that publishers' time would be better spent on development instead of "grade-grubbing."
The major factors in purchasing decisions, according to Creutz, are genre, whether a player liked the previous game in a series and, unsurprisingly, price. So there you have it publishers, to be successful, all you have to do is make a sequel to a popular game in a genre that a lot of people like. And make it cheap. If that's not possible, two out of three ain't bad.












Reader Comments (Page 1 of 2)
ChuckBartowski (ATDF Technical Consultant) @ Nov 25th 2009 11:04PM
Thank You Cowen!
Urza @ Nov 25th 2009 11:42PM
Thanks? Pssssh. We knew this.. the publishers are just idiots.
Dreaded Fear @ Nov 25th 2009 11:06PM
What a happier place the internet could be, if it wasn't for those damn review scores.
Or at least people who actually read the reviews, rather than look at an arbitrary number.
AerialAngel87 [PSN ID - AerialAngel] @ Nov 25th 2009 11:11PM
I read the reviews and look at the ups and downs of the game. I do look at the number but if its Ups satisfy more then the Downs then i could care less if a game got 5.3 out of 10.
nutman @ Nov 25th 2009 11:09PM
It's weird how divisive this is in the gaming community.
Personally, I like having review scores, but I also read the review unless it's some shit on IGN that's 6 pages.
bongoes Sector 2814 @ Nov 25th 2009 11:17PM
I actually read the six page reviews sometimes, but only when it's a game I'm seriously thinking about getting and when I have time to kill.
Katana Master @ Nov 26th 2009 4:35PM
I like that they have 6 pages. It shows how much detail they have went into. Unlike the basic Gameplay,Graphics then a summary of what they have already said.
There videos are very good too, I usually checked then out for when I'm undecided on a game and then read the written review for more detail if I need to. Games that I will read the written reviews will usually be RPG's or a huge FPS title (CoD, Halo, Half Life, etc...)
AerialAngel87 [PSN ID - AerialAngel] @ Nov 25th 2009 11:10PM
Well they do matter since i use them to decide if i should get a game or not.
I was going to buy Need For Speed Undercover but i seen the reviews before it came out and obviously it wasnt great. Just like the scores said.
Metacritic scores dont matter ? Um right. Just like how my 60$ towards a game doesnt matter. No no no no I can make another 60$ in a matter of seconds.
/sarcasm
ChuckBartowski (ATDF Technical Consultant) @ Nov 25th 2009 11:15PM
oh how i was relieved to see that /sarcasm tag at the end.
tmacairjordan87 @ Nov 25th 2009 11:17PM
Oh, so that's why Wii Music sold so well. Until now, I simply couldn't figure it out!
I can't believe analyst's get paid to make obvious statements like review scores =/= sales all the time.
eNrique @ Nov 25th 2009 11:32PM
I can't believe you come here just to make obvious statements like review scores =/= sales all the time.
tmacairjordan87 @ Nov 25th 2009 11:37PM
I can't believe you come here just to troll other people.
Seriously, why are you here? This article doesn't have a ps3 tag on it.
johnnynumber5 @ Nov 25th 2009 11:40PM
jeez guys can't you just put your peeners away ... it's the holidays for christs sake.
tmacairjordan87 @ Nov 25th 2009 11:46PM
I'm just happy I have no class tomorrow or Friday morning, that's it. I don't personally enjoy celebrating the massacre of indians and the stealing of their lands. Wouldn't be here if not for that, don't get me wrong, but I just don't openly celebrate and parade it.
Darth Bradwart, The Dark Lord of the Sith @ Nov 25th 2009 11:54PM
Why wouldn't you celebrate it?
Manifest Destiny!
johnnynumber5 @ Nov 26th 2009 12:06AM
Whatever works for you. I don't think the point is really celebrating an aboriginal holocaust of Indigenous Native Americans so much as being thankful for the things you do have in your life. A perfect example would be that you have the chance to further your education and being blessed enough to have a computer so that you can go online and post on this blog. There is nothing you nor myself can do to go back in time and change the atrocities of those who shed blood in the name of our country. Have your meal in celebration of their memories if you must and knowing that in the very the least their legacy hasn't been forgotten by everyone.
Again - put your peeners away it's the holidays.
The Dark Wayne [Planeteer: Power of the Batusi] ATDFs Financier and Batman @ Nov 26th 2009 12:16AM
what's the holidays without a good ol dick measuring round the turkey?
Marius Returns @ Nov 26th 2009 12:18AM
so do you loose sleep for the children in Africa?
tmacairjordan87 @ Nov 26th 2009 12:24AM
I don't feel bad for anyone, more like disgust at how my ancestors handled things...not a fan of celebrating genocide. Not a fan of the modern thanksgiving either, as it usually means being forced to eat around some people I don't enjoy being around.
It's kind of cheap too, everyone pretends to be thankful because they feel like they have to, then go back to being ungrateful sons of bitches the other 364 days of the year.
MystileArmor @ Nov 26th 2009 12:28AM
You all should thank me. My ancestors were the ones that had the need to go everywhere in a boat.
Darth Bradwart, The Dark Lord of the Sith @ Nov 26th 2009 12:32AM
Crazy Dutch bastard...;)
johnnynumber5 @ Nov 26th 2009 2:12AM
@Wayne
you made me lol hard on that one. As in a real gut buster. I'm thankful for that!
sonicspike41 @ Nov 26th 2009 3:04AM
Personally, consider the number of people that support the military, it seems kind of pointless to feel bad about the past.
What's done is done. If we want to change something, we should consider changing the current military instead. I'd rather see that $400 billion a year spent on defensive technology rather than used to pay people to kill each other.
finnith @ Nov 26th 2009 3:10AM
Sometimes, there's no point looking at history and historic figures for what they were, but for what they've become. I'm not saying the ends always justify the means but there are still cases where that's true.
Rubedo @ Nov 25th 2009 11:25PM
yay KITH
Starkicker @ Nov 26th 2009 12:43AM
Just a thought, but how many people who actually get the Kids in the Hall reference are Canadian?
Ethan Rom @ Nov 26th 2009 11:04AM
I couldn't believe I saw a reference to Kids in the Hall on Joystiq. and I am not a Canadian, but I do love that show. Just had a marathon DVD session with a girl I met who is a fanatic for this show.
hdcase @ Nov 26th 2009 12:01PM
Well Kids in the Hall was on Comedy Central (formerly the Comedy Channel) here in the US so it's probably more well known than you'd think. And yes it is awesome.
fuzzy @ Nov 26th 2009 2:54PM
I was so excited to see the KITH refrence that I didn't even read the article. Good on ya' joystiq
Richard 2.6 @ Nov 26th 2009 3:28PM
I'm American, but definitely caught the reference. KITH was easily my favorite sketch show. I only even checked the comments for this post to see the inevitable comments about the image. Meanwhile that image is perfect considering all the "well, no shit" things the 30 Helens would agree with.
Mr. M @ Nov 26th 2009 4:27PM
I'm from Sweden and I got it as well.
The show actually ran here on Swedish television some 10-15 odd years ago, on a crappy equivalent of MTV.
Been trying to find the DVD's here in Sweden, but I'm starting to think that I'm going to have to import them.
MystileArmor @ Nov 25th 2009 11:33PM
Offcourse they don't matter, some asshat at Gamezone gave Tony Hawk Ride a 92!!!
Maulok @ Nov 25th 2009 11:37PM
Analyst: Metacritic scores don't drive success
"You don't say..." -Okami
brian @ Nov 26th 2009 10:02AM
it's sad when good games don't sell well.
johnnynumber5 @ Nov 25th 2009 11:38PM
More than anything I think Metacritic is just banter for the die hards. However, I'd be lying if I said I don't use it as a tool sometimes to make a snap judgement if I'm interested in a game I don't know much about. I don't really use it to eliminate games but I do use it to sell me on games sometimes. I would say that 95% of the time I know what I'm going to buy when I walk into the store but sometimes I do check out Metacritic if I'm on the fence about a game. I typically don't even pay attention to the overall average so much as I look at the scores themselves ... if half are high and half are low I know it's a love it or hate it game but if the scores are pretty even across the board it's probably a game that is at least universally agreed upon as quality.
G-Anderton @ Nov 25th 2009 11:51PM
LOL Kids in the Hall reference ftw!
Dr. steve brule @ Nov 26th 2009 12:42AM
agreed, i miss the kids in the hall.
looks like we're the only ones to get it so far too.
RadiantViper @ Nov 26th 2009 6:31PM
Best reference on Joystiq in a while ... made me chuckle.
Darth Bradwart, The Dark Lord of the Sith @ Nov 25th 2009 11:58PM
So I should stop basing my purchases off of reviews, then?
Republic Heroes, Tony Hawk: Ride, and GI Joe, here I come!
/s
zeh @ Nov 26th 2009 12:26AM
"Analysts agree: Analysts opinions just don't matter"
tiamat5 @ Nov 26th 2009 12:40AM
Of course metacritic scores don't matter, only gamer stupidity and ignorance matters in the long run. this why copy and paste games like modern warfare,halo and left4dead thrive while gems like okami, psychonauts,viewtiful joe and LBP sink in to obscurity.
Alton Brown (Now With Mystic Eyes of Death Perception!) @ Nov 26th 2009 12:51AM
You are just adorable.
Dr. steve brule @ Nov 26th 2009 1:20AM
@tiamat, i know right, fuck a world where we can have both good games like left 4 dead and cod mw2, coexisting in a world with awesome games like psychonauts and shadow of the colossus.
@alton brown, your show is about to come on. and im about to watch it.
Alton Brown (Now With Mystic Eyes of Death Perception!) @ Nov 26th 2009 1:24AM
I watch your show too, Steve. That advice about stop, drop, and roll saved my life.
For your health!
Billy Magnum @ Nov 26th 2009 12:54AM
Major props on the kids in the hall usage Joystiq!
Genome4824 @ Nov 26th 2009 1:18AM
it's the fastest way for me to get links to whoever has reviews for new games up first
Jonah @ Nov 26th 2009 2:03AM
I don't even care what this article is about. Kids In The Hall was an awesome show. Props to Joystiq, and Happy Thanksgiving.
m0m0 @ Nov 26th 2009 2:34AM
for the core gamer's dollars, rating does matter. what doesn't matter is core gamer's dollar. so in the end, rating doesn't matter. see the logic?
Peter R. @ Nov 26th 2009 2:41AM
Lol, what nonsense! Maybe Metacritic scores don't matter (who goes to that site for game reviews anyhow?! I definitely don't), but review scores from other well-known sites do (except for you gamespot, you've been blacklisted). As a hardcore gamer, I'm not gonna spend my money on a game that ain't worth it just because I liked the prequel to that game. And I'm definitely not gonna buy a game just because it happens to be in the genre I prefer;there's already a ridiculous amount of crappy FPS and RPG games in the market. Price is the point where I would agree with Mr. Creutz, but again, as a hardcore gamer, price only affects WHEN I would buy a good game and not IF I'd buy it. There's like four $60 games I want right now, but because I don't have $240+ to spend right now, I'd have to buy them one at a time (starting with the one I want the most to the least).
When you go analyzing how reviews affect purchases, the observations have to be broken into two groups, the true hardcore gamer vs. the poser hardcore gamer & casual gamer. The true hardcore gamer won't blindly purchase any game. Reviews, information, and first-hand experience with a game will make or break their decision to buy it. Poser hardcore gamers on the other hand, will purchase a game based solely on the fact that they liked the prequel; even if it's crap (and no, playing numerous generic FPS games, doesn't make you a hardcore gamer). While casual gamers will pop into a Gamestop once in a while, and buy whatever game has good cover art/description and comes in a genre they generally like.
So essentially, reviews matter only to the hardcore gamer.
The Flyin' Hawaiian @ Nov 26th 2009 3:02AM
Fuck no. when is the last time you saw a game garner a metacritic score below a 90 and be a cult hit? in the last 5 years, probably never.