Metacritic is stupid, but only because review scores are also stupid

Default_picture
Friday, August 17, 2012
EDITOR'S NOTEfrom Sam Barsanti

Game reviews are in a weird position these days. Lots of people agree that something about them needs to be changed, and yet lots of people still love clicking on a review just so they can scroll to the bottom and read the score. Ash believes that they need to be dropped altogether. 

Metacritic

With the recent job offer from Irrational games asking for a developer who has worked on a title that scored 85+ on Metacritic (an arbitrary number for sure, but no more than asking six years of experience instead of four or five), the copy/paste machine that we call the Internet is in full rage mode again against those practices. Typically, two parties are blamed: either the evil developers and publishers who put that much emphasis on the Metascore, or Metacritic itself.

And while everyone loves to complain about how Metascores are arbitrarily defined aggregates of arbitrarily chosen reviews with an arbitrary (and secret) weighting, the most guilty party of all, the one without which all of this could not happen, is silently left behind: the review scores given by so-called "professional" reviewers that are at the basis of the aggregation. Review scores are at the heart of our gaming culture and they need to go.

 

Big outlets like IGN and GamesRadar have recently attacked Metacritic for "destroying the industry.” Of course, one must not forget that those website have what we may call a slight conflict of interest in this debate. Metacritic is a big threat to the major gaming sites that used to rule the world. These sites used to get all the traffic from people wanting to quickly find out wether or not a game is "da bomb" or "sucks ass.” Before Metacritic, regular people who don't have hours to spend on making a game purchase decision would go to IGN, see an eight and say, "Oh, shit. This looks lame.” Now they see an 81 on Metacritic, with Gamerzine Russia giving a 100 and Edge Magazine the usual 20. What's worse, really ? The arbitrary aggregation or the arbitrary scores? Would we rather go back to a time where only a handful of outlets controlled the fate of our games?

The practice of giving a numbered score at the end of reviews is the real problem here. Putting a number on a game at the end of a review is meaningless and should never be done. Why is that ? Let me give you a few reasons:

1. A $15 game may or may not be scored the same as a $60 game, but the more expensive one is not re-scored when its price drops.

2. A game that ships with countless bugs (hello, Fallout: New Vegas) may lose an arbitrary number of points over the problems it has, even though a day one patch might correct it and regular players like you and I will never notice it.

3. You never know when a game is reviewed by a total fanboy or a hater of either the developer, the platform (for exclusives), the genre, or the series. Reading the review might help you understand if a title will be to your taste or not, but certainly not the score.

4. You never know how much of a game the reviewer has actually played.

5. A game on multiple platforms will typically only be scored for the one it performs best on.

6. Remakes generally have over-inflated scores so as not to go against the score given 10 years ago by the same outlet with very different criteria.

11. A game with average graphics on a high-end console will lose points over a game with horrible graphics on a low-end console (hello, Xenoblade), thus encouraging developers to do the later more often.

And the list goes on and on.

If IGN and GamesRadar are serious about their attack on Metacritic (and not just harassing a competitor), they should eliminate the base of the problem: numerical review scores. This obsession with numbers is the real issue faced by the industry, not the fact that a third party happens to aggregate them.

 
Problem? Report this post
BITMOB'S SPONSOR
Adsense-placeholder
Comments (2)
Default_picture
August 17, 2012

I can understand why review scores exist.  Some people don't want to read a full text review and just want a quick indicator of should I buy this or not.

The real problem comes from the people that try and compare scores between two games that are in entirely different genres (for example, Minecraft and Batman: Arkham City - two games that scored similar Metacritic ratings) or people who say that any game is better in any way simply because it received a higher score.

Metacritic just sucks.  I hate how so many people put all of a game's worth on its aggregate score, even if the game sells well and is really liked.  How many stories have we read about developers not getting bonuses or being shut down due to low Metacritic scores?

I do disagree with a few of your points.  Reviews are meant to be impressions of a game at the moment the review is written.  If the game is fixed or the price is lowered, that shouldn't affect that reviewer's score in the slightest.  The person who bought that game day 1, not just the reviewer, needs to know those things.

The best thing you can do is find a site or two that you trust completely with game reviews.  Not all of them are petty about graphics or don't actually finish the games they review.

Default_picture
August 17, 2012

I don’t see the point of the numerical (or letter) grade, particularly today.

I do agree with Justin for a couple of his points. A review is his/her reflection and experience with a game (and makes sense to explain it freshly after playing it). How did it make the player feel after undergoing it? What is the outcome you may get? I think there’s a niche of people who still want to hear that. I think it’s neat to hear other people’s experiences with a game, because many will be different.  

But, like you said, the number is the issue. It’s not relevant to choosing a decision based on a score. Many people have different insights and tastes, and that will never change.

Another thing to note here is you mentioning remakes. I see your point. Is it even fair to degrade a phenomenal title from the past because its standards don’t match the current generation? Probably not. Yet, you have to think at the same time if the game is still worthy as it was back then. Will you enjoy it now? That’s not something I think is semi-accurate for a review, but the community will still want an opinion and whether they should repurchase it.

Are some people too lazy to read and need the quick information? Come on man, it's the game industry and it's special to talk about it.

That decision, as I always believed, is up to you (the gamer).

You must log in to post a comment. Please register if you do not have an account yet.