Separator
The Insignificance of One Review Score
Default_picture
Thursday, January 28, 2010

Every week, excitement is brought to me by gaming podcasts. News about the industry, whacky office stories, and the video game discussion with familiar voices fills me with glee and provides a nice distraction in my everyday work. However, assigning review scores to games is a topic that comes up too often and my interest flushes out faster than a Guitar Hero sequel. Complaints about Metacritic’s conversion rate, accusations of bribery, and pressure from publishers all coexist with a controversial review score. Controversial review scores do not exist and I’m going to explain why.

Gamespy’s Uncharted 2 and 1up’s Last Remnant Metacritic scores work as great examples of believed controversial review scores. The comments for those reviews provide a display of irrational behavior, crying foul and controversy.

                                

Figure 1: Uncharted 2’s Review Score Distribution according to Metacritic. The score was 96.

Uncharted 2 received a 4.5/5 stars from Gamespy which translates into a 90 on Metacritic. It was posted with a batch of early reviews but was met with vitriol because it was believed that the reviewer had an agenda to ruin the Metacritic score.

  “Wow 4.5 and "one of the best games this gen" yo  said. Fuk me and NFS gets a 5/5 well someone is  out to lower the Meta score. “- Gamespy user

 “Gamespy are stealth fanboys NEVER giving a  PS3 exclusive a perfect score. …It currently sits at  97 on Metacritic yet N4S shift 84 on Meta received  a higher score? WTF“– Gamespy User

 

Since I do not know the exact method the Metascore is calculated, my calculations are based off a standard mean from the scores posted on Metacritic. A 90 appeared to be low and superficially looked like it would lower the average.

 

Average

Of All Current Scores listed

96.19

Without Gamespy's

96.25

If Gamespy gave it a 0

95.33

According to my findings, if the 90 were to be excluded from the set of reviews and the Metacritic scores were recompiled the average resulted as a 96, which matched the Metacritic score. Now, by some infinitely small chance the reviewer had an agenda to lower the Metacritic score and gave the game a 0, the average would be decreased by .86 of a point. Further proof is no longer needed to show Gamespy’s 90 did not significantly lower the average or deserved a controversial label.

1up’s Last Remnant review score shares the same reputation but also appeared to be a prime example of Metacritic’s poor conversion system.  The conversion from D to 25 was harsh and seemed to drag down the Metacritic score, 66.

 “Don't trust this guys reviews, you can compare  this review to any other and see that its way over  the top, each of the reviews are praising the game  making it out to be 8-9 standards but because of  these slight technical flaws ... Just read the users  reviews and scores and compare them to the  official reviewers if your going of scores and  reviews...Alot of people didn't want to get this  game because of bad reviews but are saying they  really enjoyed it.” -1up User

 

Average

Average with 1up's Score

66.49

Average without

67.35

 

 

 Shown above the average was raised by .86 of a point with the exclusion of 25. If the letter grade of D were to be properly translated into a higher score from the 60-70 range, an equally weak result would occur. At the same time if a score were to be artificially inflated, the average would hardly be moved as well.

 The suggestion that review scores do not matter is    not what I’m suggesting. For reviews, a score serves  a purpose; however, the lesson is, a reviewer  should not hesitate to assign a score he feels a game  deserves, nor feel notoriety from a perceived low  score, because it doesn’t affect the final Metacritic  score. The review space is a large population with  many opinions, drowning out singular voices. This  dynamic denies the existence of controversial  review scores. Destruction isn’t caused by a single bullet like a bullet hell shooter.  A grand conspiracy among all reviewers, from every part of the globe mutually agreeing to assign the same score would be the only way to have a dramatic influence on the Metacritic score, or in the event of a high profile game receiving a small group of reviewers, 3 or less and one of the scores was drastically different from the others. DSi ware or iPhone games are the only types of games that fit the profile of less than 5 review scores, but by their nature they would never warrant the attention needed to label them as controversial. The current media landscape prevents the existence of controversial review scores.  

 
0
BITMOB'S SPONSOR
Adsense-placeholder
Comments (0)
You must log in to post a comment. Please register or Connect with Facebook if you do not have an account yet.