Speaking to GI.biz, Sega Europe president and COO Mike Hayes discussed the importance of Metacritic, specifically to publishers approaching developers about future projects. Hayes said that being able to "put objectivity" into the video game business is very important when publishers are putting millions of dollars on the line. "You have to try and find that objectivity," said Hayes, "and it's going to come from how much it costs, when it's coming out, and how good the game is."
In particular, Hayes said that Metacritic scores are important for "high-end Playstation 3 or Xbox 360" titles that are attempting to "break out" in a particular genre. "You have to target that quality," said Hayes, "because otherwise you don't have a hope in Hell." He added further that there is "too much evidence" that games that fail to surpass a certain Metacritic score "are not going to cut through."
Still, according to Hayes, Metacritic isn't the only consideration, as several factors -- such as release date, platform availability, and whether or a not a game is part of an established franchise -- affect a game's success. Hayes believes it would be wrong to make Metacritic score targets a part of every developer contract, but notes that it's not unfair for publishers to have "certain expectations of quality levels" for expensive projects. "But to demand it on absolutely everything," he said, "wouldn't be right at all." There's a Sonic Unleashed joke in there somewhere.
Reader Comments (61)
Posted: Feb 1st 2009 5:50AM Bowser Rogozhin said
You are a racist, I remember the incendiary comments clearly. But you, being Indian, probably have that sort of attitude built up from a young age. Caste system, and all. Your parents have failed you so it's to be too critical.
Reply
Posted: Feb 1st 2009 10:20AM Bowser Rogozhin said
*Your parents have failed you so it's hard to be too critical.
Reply
Posted: Jan 31st 2009 12:48AM OMGOMG said
Well, I still love Sega. Without the Dreamcast, there would be no 2K Sports. I know most here aren't sports fans, but as a passionate one myself, the NFL and NBA 2K series hold a very special place in my heart.
Now, I know Sonic didn't do so well lately; however, as a publisher, they've got a bona fide hit with the Condemned series. Plus, I am very much intrigued by Mad World and The Conduit.
I know it's cool to hate on the Wii, and Jebus knows I've done my share of it, but I really do want the Wii to succeed both as a hardcore and family friendly console. There was really something special on Christmas day, enjoying one of my favorite activities with my grandparents. And dude, my Grandpa fucking rapes at Boom Blox. Like, don't fuck with him. He'll make you go home and cry.
Anyhoo, I've been drinking (shocking, can you tell with the randomness?) and I'll go away now.
Woo!
Reply
Now, I know Sonic didn't do so well lately; however, as a publisher, they've got a bona fide hit with the Condemned series. Plus, I am very much intrigued by Mad World and The Conduit.
I know it's cool to hate on the Wii, and Jebus knows I've done my share of it, but I really do want the Wii to succeed both as a hardcore and family friendly console. There was really something special on Christmas day, enjoying one of my favorite activities with my grandparents. And dude, my Grandpa fucking rapes at Boom Blox. Like, don't fuck with him. He'll make you go home and cry.
Anyhoo, I've been drinking (shocking, can you tell with the randomness?) and I'll go away now.
Woo!
Posted: Jan 31st 2009 2:55AM (Unverified) said
not true my mom is in her 50s and plays her 360 all the time
thing is she was a gamer all the time
i come home form school and he be hoging my new game
Wii just gets NON-gamers to play
Reply
thing is she was a gamer all the time
i come home form school and he be hoging my new game
Wii just gets NON-gamers to play
Posted: Jan 31st 2009 3:03AM RKN said
I know, my parents are absolute NON-GAMERS, they have never picked up a controller in their entire life. Although the 360 and PS3 also have games that can get non-gamers to get up and pick a controller but I think a Wii would be more up their alley, it may feel less intidimating to them.
Reply
Posted: Jan 31st 2009 9:14AM LuiginDaisy said
@Chinpo:
It doesn't work for my parents.
My mom is too scared of the controller. She thinks it's going to bite her, or she'll break it. I even showed her pictures of people getting injured with it, to show her that it's practically unbreakable, but she's still afraid of playing it. The closest I got her to playing was trying to bowl when she was drugged on codeine. She never released the ball.
My dad, on the other hand, was willing to give it a try. I started up a game of Wii Tennis, and he was surprised that he would have to swing the other way to get the ball on the left side of the screen. I believe his first words were "What the fuck?"
Reply
It doesn't work for my parents.
My mom is too scared of the controller. She thinks it's going to bite her, or she'll break it. I even showed her pictures of people getting injured with it, to show her that it's practically unbreakable, but she's still afraid of playing it. The closest I got her to playing was trying to bowl when she was drugged on codeine. She never released the ball.
My dad, on the other hand, was willing to give it a try. I started up a game of Wii Tennis, and he was surprised that he would have to swing the other way to get the ball on the left side of the screen. I believe his first words were "What the fuck?"
Posted: Jan 31st 2009 4:17PM (Unverified) said
My dad originally got a PS3 to play blue ray movies, and hasn't used a controller since he tried to play Golden Eye with me on the N64.
He has now finished a lot of games, some include GTA4, Assassin's Creed, Prince of Persia and he's playing through Fallout 3 right now.
Reply
He has now finished a lot of games, some include GTA4, Assassin's Creed, Prince of Persia and he's playing through Fallout 3 right now.
Posted: Jan 31st 2009 1:02AM (Unverified) said
God, Sega, I don't even care anymore, just please please please make good Sonic games again :(
Reply
Posted: Jan 31st 2009 1:32AM Johnnynumber5 is powered by cell said
I wouldn't say the Lions are an appropriate sports analogy. The Mets are probably better because you remember them doing well in the past (like SEGA) but lately have shown great promise but ultimately shoot themselves in the foot and implode from within. Actually I think the Mets comparison is dead on.
I'm a Bears fan and I think thats a better NFL comparison. Again, a team we all remember from our childhood as being great (superbowl shuffle) but as of late are the definition of mediocrity always making the same problems year after year. The Bears haven't had a good QB since Sonic had a great game.
Reply
I'm a Bears fan and I think thats a better NFL comparison. Again, a team we all remember from our childhood as being great (superbowl shuffle) but as of late are the definition of mediocrity always making the same problems year after year. The Bears haven't had a good QB since Sonic had a great game.
Posted: Jan 31st 2009 1:57AM Scratchcard said
And they also cannot seem to get out of the shadow of their "cross-town rivals" (Nintendo and the Yankees)
Reply
Posted: Jan 31st 2009 10:43AM (Unverified) said
*looks at his own name*
*starts silently weeping*
Reply
*starts silently weeping*
Posted: Feb 1st 2009 12:03AM (Unverified) said
@ ExMcCloud:
No one is the Detroit Lions of anything except the Detroit Lions.
Reply
No one is the Detroit Lions of anything except the Detroit Lions.
Posted: Jan 31st 2009 1:26AM Johnnynumber5 is powered by cell said
SEGA is a mixed bag of nuts for me. The Dreamcast is without a doubt my favorite console of all time. It was truly ahead of its time. I wish they would stop killing Sonic like they are doing. Generally speaking their new IP's are solid games and in some cases critical darlings. Here is my SEGA text chart:
Good -
Condemned
The Club
Valkyria Chronicles
Not So Good -
Golden Axe Beastrider
Sonic Unleashed
Samba De Amigo
Sonic Chronicles The Dark Brotherhood
Incredible Hulk
Iron Man
Viking
Sega Superstars Tennis
Coming Soon!-
Alpha Protocol
Sonic's Ultimate Genesis Collection
Phantasy Star Portable
The Conduit
Madworld
Bayonetta
Storm Rise (meh)
Other than Viking everything that has sucked has been either the raping of an old franchise or a licensed game. For the most part their new IP's are on the money and great games. As a publisher they need to do their classic IP's better. It would serve them well to do HD remakes like Capcom has done as PSN & XBLA titles. For example Powerstone, Altered Beast & Marvel vs Capcom would be terrific HD remakes.
Reply
Good -
Condemned
The Club
Valkyria Chronicles
Not So Good -
Golden Axe Beastrider
Sonic Unleashed
Samba De Amigo
Sonic Chronicles The Dark Brotherhood
Incredible Hulk
Iron Man
Viking
Sega Superstars Tennis
Coming Soon!-
Alpha Protocol
Sonic's Ultimate Genesis Collection
Phantasy Star Portable
The Conduit
Madworld
Bayonetta
Storm Rise (meh)
Other than Viking everything that has sucked has been either the raping of an old franchise or a licensed game. For the most part their new IP's are on the money and great games. As a publisher they need to do their classic IP's better. It would serve them well to do HD remakes like Capcom has done as PSN & XBLA titles. For example Powerstone, Altered Beast & Marvel vs Capcom would be terrific HD remakes.
Posted: Jan 31st 2009 1:48AM (Unverified) said
the games that Sega publishes are generally good. They can't seem to get their heads straight when it comes to their old franchises though.
I'm really looking forward to Alpha Protocol, as I've heard it described as a gritty mass effect-type game... with actual consequences for your actions.
I'm also interested in seeing how Madworld and The Conduit will pan out sales and reviews wise.
I'm guessing Bayonetta will come in between a 7.5-8.5 meta (Conduit will clock in at an 8.7-9.2 and Madworld with a 8.6)
Reply
I'm really looking forward to Alpha Protocol, as I've heard it described as a gritty mass effect-type game... with actual consequences for your actions.
I'm also interested in seeing how Madworld and The Conduit will pan out sales and reviews wise.
I'm guessing Bayonetta will come in between a 7.5-8.5 meta (Conduit will clock in at an 8.7-9.2 and Madworld with a 8.6)
Posted: Jan 31st 2009 2:39AM Johnnynumber5 is powered by cell said
I'm thinking the Conduit comes in a little lower than that average. If I had to guess I would say somewhere around 7.4-8.1 meta for the conduit.
Madowlrd will probably be around an 8.4 or 84/100 meta avg.
Bayonetta I could see being the lowest which will probably come in around 6.5 -8.5. I know that's a big window but that ones hard to peg with the limited information thus far.
Out of all those games Madworld will end up being the critical darling that is a commercial flop. That's pretty much the story of Clover Studious games anyway. I think the Conduit will probably push somewhere around 600k-800k which will be good for that game and will merit a sequel. Bayonetta will barely crack 1 million across both platforms.
Reply
Madowlrd will probably be around an 8.4 or 84/100 meta avg.
Bayonetta I could see being the lowest which will probably come in around 6.5 -8.5. I know that's a big window but that ones hard to peg with the limited information thus far.
Out of all those games Madworld will end up being the critical darling that is a commercial flop. That's pretty much the story of Clover Studious games anyway. I think the Conduit will probably push somewhere around 600k-800k which will be good for that game and will merit a sequel. Bayonetta will barely crack 1 million across both platforms.
Posted: Jan 31st 2009 3:22AM (Unverified) said
Yes, SEGA as a publisher is definitely much better than SEGA as a developer. Oh, how I still mourn the assimilation of Smilebit. :(
Reply
Posted: Jan 31st 2009 2:33PM (Unverified) said
Put Virtua Fighter 5 and the Phantasy Star games on the list ;).
Reply
Posted: Jan 31st 2009 2:32AM (Unverified) said
O rly Sega?
You can do it! Just release a new Space Harrier to really mess with kids minds these days!!!
Reply
You can do it! Just release a new Space Harrier to really mess with kids minds these days!!!
Posted: Jan 31st 2009 2:33AM ZippyDSMlee said
So its important as its always been to lie about scores?
Reply
Posted: Jan 31st 2009 2:45AM (Unverified) said
The problem with metacritic/gamerankings is that it can really paper over some differences of opinion.
a 50% score on metacritic could mean lots of people thought it was average, or half the people thought it was awesome and half the people thought it sucked.
Unusual or off the wall games tend to suffer in this way on metacritic. Several recent Wii games fo example have had totally split reviews.
--
Its weird that this seems to be the opposite to other media on metacritic... in the movie and music section its often the really niche/arty/obscure movies/albums that have the best scores... maybe because they get a lot less reviews... or maybe video game critics are just less adventurous/stuck up/clever.
Reply
a 50% score on metacritic could mean lots of people thought it was average, or half the people thought it was awesome and half the people thought it sucked.
Unusual or off the wall games tend to suffer in this way on metacritic. Several recent Wii games fo example have had totally split reviews.
--
Its weird that this seems to be the opposite to other media on metacritic... in the movie and music section its often the really niche/arty/obscure movies/albums that have the best scores... maybe because they get a lot less reviews... or maybe video game critics are just less adventurous/stuck up/clever.
Posted: Jan 31st 2009 12:04PM Mr Khan said
Ah, well let's go with Giant Bomb using the 5-star scale. 2.5/5 stars is a 50% for metacritic, but an average game. 50% out of a 100% scale generally does mean absolute trash, then there's 1up's system which has been totally misinterpreted (where a C is 50%, which totally doesn't match up to the system we used in school, and we can presume 1up is using)
so yes, that is somewhat the effect. What a reviewer INTENDS by giving something a 5/10 does not reflect how the 5/10 is interpreted on metacritic
Reply
so yes, that is somewhat the effect. What a reviewer INTENDS by giving something a 5/10 does not reflect how the 5/10 is interpreted on metacritic
Posted: Jan 31st 2009 5:58AM Bowser Rogozhin said
It's pretty disappointing to see a big publishers and developers using Metacritic as a barometer for potential success. Understandable, but disappointing all the same. Such ideologies will only encourage an incestuous homogenisation amongst gaming as a whole, a 'me too' mentality.
The bull-like attitude of top brass infuriates me so because it's so short sighted. Anything remotely left field will get shot down in favour of what is currently topping an opaque ranking site. With absolutely no thought given to the arbitrary nature of these reviews, the quality, or how influenced they may have been by external or internal factors. No nothing. Just follow the number.
Reply
The bull-like attitude of top brass infuriates me so because it's so short sighted. Anything remotely left field will get shot down in favour of what is currently topping an opaque ranking site. With absolutely no thought given to the arbitrary nature of these reviews, the quality, or how influenced they may have been by external or internal factors. No nothing. Just follow the number.
Posted: Jan 31st 2009 11:53AM xxxsam said
People always give the same old whine about Metacritic - and numerical scores in general. It's tired as fuck.
With single-review numerical scores, there's some degree of a fair point to the rant. They aren't particularly valuable, because maybe that reviewer didn't get the game or whatever - useful as a summary of what that reviewer thought, yes, but as an actual evaluation of the game on its own, no. (Same is true of the text of the review.)
But the aggregate largely solves that problem and that's why publishers - and everyone else - can generally rely on it.
I'm sure there are a few exceptions but go look at a Metacritic score list, pick some games you played, and ask one question: do these scores approximately represent game quality? There are definitely going to be games you personally would score differently, but if you try to make as objective a judgement of the game as you can, is it *really* all that different from the Metacritic score? How much?
Personally, I just did a quick run-through of the Wii chart, looking at the first ten games I played. I'd say nine of those games are within 10 points of what I'd have given (the other one's maybe 15). That's pretty damn accurate.
Try the same exercise, with the same 10-point range. If you want to do it properly, write out your trying-to-be-objective scores first using the 7.5=okay/average scale that Metacritic follow, then compare them against the site. (And don't pre-pick games you know to be controversial.) Maybe you'll get a lower proportion of accuracy, but I'd be willing to bet that for the majority of people, it works out.
Some of the perceived problems with Metacritic scores are due to people being arsey about them - like, game A got a 93, and was totally better than game B which got 96. Nobody gives a shit when the numbers are in that range, both games are great. But I think there's a distinctive difference between a 60 and an 80. And if publishers are looking at an actual metric for 'how shit is this game' - something Sega first-party badly and frequently needs - Metacritic is the best game in town.
Reply
With single-review numerical scores, there's some degree of a fair point to the rant. They aren't particularly valuable, because maybe that reviewer didn't get the game or whatever - useful as a summary of what that reviewer thought, yes, but as an actual evaluation of the game on its own, no. (Same is true of the text of the review.)
But the aggregate largely solves that problem and that's why publishers - and everyone else - can generally rely on it.
I'm sure there are a few exceptions but go look at a Metacritic score list, pick some games you played, and ask one question: do these scores approximately represent game quality? There are definitely going to be games you personally would score differently, but if you try to make as objective a judgement of the game as you can, is it *really* all that different from the Metacritic score? How much?
Personally, I just did a quick run-through of the Wii chart, looking at the first ten games I played. I'd say nine of those games are within 10 points of what I'd have given (the other one's maybe 15). That's pretty damn accurate.
Try the same exercise, with the same 10-point range. If you want to do it properly, write out your trying-to-be-objective scores first using the 7.5=okay/average scale that Metacritic follow, then compare them against the site. (And don't pre-pick games you know to be controversial.) Maybe you'll get a lower proportion of accuracy, but I'd be willing to bet that for the majority of people, it works out.
Some of the perceived problems with Metacritic scores are due to people being arsey about them - like, game A got a 93, and was totally better than game B which got 96. Nobody gives a shit when the numbers are in that range, both games are great. But I think there's a distinctive difference between a 60 and an 80. And if publishers are looking at an actual metric for 'how shit is this game' - something Sega first-party badly and frequently needs - Metacritic is the best game in town.
Posted: Jan 31st 2009 12:07PM Mr Khan said
Aggregate doesn't help, though, because it's still an aggregation of single reviews. I seriously think the whole "second opinion" system that one mag (who was it? My hated Game Informer, or GamePro, or EGM, i forget.) had was one of the more brilliant moves, as it showed whether a game was truly bad or good or there was merely a lack of consensus. Equally true with Famitsu scores, if you break them down into four reviews set out of 10, instead of one out of 40
Magazines and web sources themselves should have aggregate reviews. Helps weed out all the problems with personal opinion and/or lazy, stupid, or biased reviewers
Reply
Magazines and web sources themselves should have aggregate reviews. Helps weed out all the problems with personal opinion and/or lazy, stupid, or biased reviewers
Posted: Jan 31st 2009 12:17PM Bowser Rogozhin said
You have a grotesque obsession with numbers, huh.
Metracritic is mainstream media incarnate. Reducing games from all their glory, the hard work of real men and women, to a subjective the greatest slur to our hobby. Yes, let us all ignore what one thinks of the content, the style, the controls of Game A; give me a number, give me a number so I can be told what to like. The fact that you subscribe to such a manuscript fills me with such great disappointment, but if you enjoy neutralising your own thoughts then go ahead.
Your little experiment fails at the first hurdle because a number is wholly subjective.
"7.5=okay/average scale"
Who on earth says I subscribe to that viewpoint? What if I think, shock-horror, 5 should be average? Or maybe three? Wouldn't the results be greatly skewed if we lower the barometer?
Does Metacritic take into fact factors of manipulation such as hype or bribery, the prejudices or the reviewer or the the editorial stance of a site?
Your argument has more holes than a whores panties on a Soho corner. Try harder.
Reply
Metracritic is mainstream media incarnate. Reducing games from all their glory, the hard work of real men and women, to a subjective the greatest slur to our hobby. Yes, let us all ignore what one thinks of the content, the style, the controls of Game A; give me a number, give me a number so I can be told what to like. The fact that you subscribe to such a manuscript fills me with such great disappointment, but if you enjoy neutralising your own thoughts then go ahead.
Your little experiment fails at the first hurdle because a number is wholly subjective.
"7.5=okay/average scale"
Who on earth says I subscribe to that viewpoint? What if I think, shock-horror, 5 should be average? Or maybe three? Wouldn't the results be greatly skewed if we lower the barometer?
Does Metacritic take into fact factors of manipulation such as hype or bribery, the prejudices or the reviewer or the the editorial stance of a site?
Your argument has more holes than a whores panties on a Soho corner. Try harder.
Posted: Jan 31st 2009 4:41PM Johnnynumber5 is powered by cell said
If there is no thing I can count on during the weekends here at Joystiq its the ranting and raving of Bowser. The point isn't whether or not you agree with his metric of what is and what isn't average but that you participate in his experiment with the criteria he has established.
I agree that in the end no one should wholly rely on an average of numbers but it does give consumers, publishers & developers an idea on a general consensus. Metacritic is a good tool for everyone to get an idea of the quality of a title. I usually feel that the median is more accurate than the average. That way you can usually eliminate the hype and the hate in one swoop.
For example, we know Bowser hates anything with violence with a fierce passion. It wouldn't be fair for him to write a review of Killzone 2 because we all know he has a built in bias. This is the point Bowser is making is that none of us know the built in bias in favor or against for these reviewers. No one should assume they all have good or evil intentions. That's why I think the median is a better barometer of quality than the average.
Reply
I agree that in the end no one should wholly rely on an average of numbers but it does give consumers, publishers & developers an idea on a general consensus. Metacritic is a good tool for everyone to get an idea of the quality of a title. I usually feel that the median is more accurate than the average. That way you can usually eliminate the hype and the hate in one swoop.
For example, we know Bowser hates anything with violence with a fierce passion. It wouldn't be fair for him to write a review of Killzone 2 because we all know he has a built in bias. This is the point Bowser is making is that none of us know the built in bias in favor or against for these reviewers. No one should assume they all have good or evil intentions. That's why I think the median is a better barometer of quality than the average.
Posted: Jan 31st 2009 4:42PM Johnnynumber5 is powered by cell said
Didn't proof read that ... sorry for any errors.
Reply
Posted: Jan 31st 2009 8:26AM (Unverified) said
Sports references!?
If Nintendo is the Yankees and Sega is the Mets.....then what's Microsoft? The Rays?
Sony....the Red Sox??
Reply
If Nintendo is the Yankees and Sega is the Mets.....then what's Microsoft? The Rays?
Sony....the Red Sox??
Posted: Jan 31st 2009 10:05AM Foetoid said
I've never heard of those teams, must be some obscure half-baked american sport. (joking)
Is it just me, or do most players in most US sports have 10 inches of padding on every inch of their body. Everyone i've ever met from the US who has sat down to watch a game of Rugby League (especially the State of Origin here in Australia, best of 3 battle between rival states) cannot believe the brutality of it all.
Rugby League FTW: http://au.youtube.com/watch?v=qJdqTh5yqrs&fmt=18
Our other sport, AFL, is also a big hitting game, but more aerial in execution lol: http://au.youtube.com/watch?v=JDMBoG4-sRU&feature=related&fmt=18
Reply
Is it just me, or do most players in most US sports have 10 inches of padding on every inch of their body. Everyone i've ever met from the US who has sat down to watch a game of Rugby League (especially the State of Origin here in Australia, best of 3 battle between rival states) cannot believe the brutality of it all.
Rugby League FTW: http://au.youtube.com/watch?v=qJdqTh5yqrs&fmt=18
Our other sport, AFL, is also a big hitting game, but more aerial in execution lol: http://au.youtube.com/watch?v=JDMBoG4-sRU&feature=related&fmt=18
Posted: Jan 31st 2009 10:11AM erh said
If metacritic scores were important "to publishers approaching developers about future projects", how the hell did Sony ever agree to buy Guerrilla Games after Killzone (PS2) scored 70% on metacritic, and the developer's other project, Shellshock: Nam '67 (PS2) scored 58%! Producing a 58% stinker is the ticket to getting Sony to deliver wheelbarrows of money?
Reply
Posted: Jan 31st 2009 4:48PM Johnnynumber5 is powered by cell said
Maybe because not everyone operates on the same premise. I know it's a crazy concept to understand that everyone is different. Liberation preformed admirably on the PSP in terms of it's metacritic average.
It's seems to be your personal crusade to inform of the world of how inept Guerilla Games is as a developer. I'm glad Sony didn't use your logic because we wouldn't of ever had the pleasure of playing Killzone 2.
Reply
It's seems to be your personal crusade to inform of the world of how inept Guerilla Games is as a developer. I'm glad Sony didn't use your logic because we wouldn't of ever had the pleasure of playing Killzone 2.
Posted: Jan 31st 2009 10:46AM foxhoundadam said
So they have seen the scores for Sonic adventure then?
Reply
Sorry, you must be logged in to leave a comment.
Featured Stories
Persona 3, Tactics Ogre, and other PSP RPGs that will live on my Vita
Posted on Feb 22nd 2012 5:45PM
The most popular posts
in the last 7 days
- Rumor: Japanese Vita devs jumping ship, Sony responds 124 comments
- Buy 2 get 1 free on select Vita games at GameStop starting today 114 comments
- Sony's Rohde: proprietary Vita cards 'completely necessary' to combat piracy 112 comments
- Sony: Call of Duty blasting onto Vita this fall 89 comments
- Asura's Wrath review: Wrecking the curve 84 comments









