Separator

Reviewer’s Remorse: New Game Smell

37893_1338936035999_1309080061_30825631_6290042_n
Wednesday, February 17, 2010

Editor's note: Are reviewers more likely to give high scores to new games simply because they're new? Chase argues from personal experience that such newness can cause one to overlook flaws. Although, I have a hunch that some high-profile games receive top scores because it's expected after so much hype. -Rob


For the past 18 months, I've written video game reviews for my college newspaper, The Maneater. The pay sucks, but the experience has been great. I feel I've grown as a writer.

But here's the thing about growth -- it implies that your earlier stuff wasn't as good.

My eyes opened to a lot of rookie mistakes when I reread many of my reviews for games released last year. Blindly following a template, using clichés -- I've done them all. But I believe one mistake deserves a bit of exploration -- unintentionally inflating a game's score because of its newness.

 

The two most prominent examples I could find were Brutal Legend and Scribblenauts, both of which I gave a 4.5 out of 5 in my paper. Hindsight being 20/20, I would probably knock a point or two off each if I reviewed them again today. So what led me to score them so highly in the first place?

Let's take Brutal Legend, for instance. Generally, I enjoyed my time with the game when it came out. The dialogue was funny, the story was interesting, and -- though not executed perfectly -- the real-time strategy mechanics were innovative.

Although I agree with every word of my original review, I feel I left out many of the game's flaws. The title has little replay value and the RTS elements are clunky.

I wish I could go back and talk to mid-October Chase to see exactly what he was thinking, but without a time machine (of which I am still waiting for -- what the hell scientists?) I'm left only to speculate.

As an amateur reviewer who doesn't have the opportunity to purchase a ton of games every year, am I suffering from rose-colored glasses syndrome? Do I see these games for what they truly are now that their newness sheen has worn off?

Or do I only feel remorse at my previous scores because I'm comparing them with the score I just gave Mass Effect 2 (also a 4.5)? Is Mass Effect 2 a better game than Brutal Legend? Absolutely.

Have my scores become skewed? Is it even fair to compare scores of games that come out months apart when the landscape of gaming has quite possibly changed drastically?

I know I've thrown out many questions here, but allow me one more. Has something like this ever happened to you? Or has the opposite ever happened, where you were too harsh on a game at first but warmed up to it over time?

You should consider these questions the next time you read or write any review.

 
Problem? Report this post
CHASE KOENEKE'S SPONSOR
Comments (23)
There184
February 11, 2010
Do you even need a score if you can communicate the qualities/flaws of a game with words? It goes the other way with me - I'll go cold on a game over time. Also: you get paid by your college paper?!
Christian_profile_pic
February 11, 2010
Count me in the "scores are dumb" camp. I understand you have to do them sometimes -- I do at the site that I write for -- but in general I don't give them too much thought. But there are games that I reviewed probably more highly than I should have, in hindsight. The original Mass Effect comes to mind.
37893_1338936035999_1309080061_30825631_6290042_n
February 11, 2010
@Alex Peanuts, but yeah, I get paid per article. And personally, I'm not a big fan of scores, but I realize their necessity. In a perfect world, I would let my words dictate what I thought of a game, but even I have fallen into the trap of loading up a review and only looking at the score it received. There are so many cons to using scores, but they all seem to be outweighed by that big pro: convenience.
Default_picture
February 11, 2010
This is totally normal. A game that felt like a 5/5 at the time can feel like a 3/5 six months later. I highly doubt any of the people that handed out 8 and 9-range scores for Perfect Dark Zero back in 2005 still feel the same way about that game. But the score reflects how you felt about that game at that particular point in time, and that's all that matters. If you read a review, you just have to remember that, despite the "finality" that a review suggests, the scores are totally ephemeral. I'm personally a big fan of [url=http://www.giantbomb.com/features/best-of-2008/1/?category=6]Giant Bomb's "Best Game of Last Year" category[/url] they include with their GOTY stuff. I wish more sites would sit down and reevaluate their previous choices. After a full year of reflection, new favorites inevitably stand out.
Default_picture
February 12, 2010
I fully understand the reasoning behind attaching a score to a review in a publication. It attracts the eye, and hopefully the reader will be curious as to why you gave that game its score, and read the rest of your review. I completely agree with AJ in the sense that the progression of time can definitely skew the way we look at older games. For example: I played the pants off of Mario Kart 64 when I was younger, but now I consider it to be the scourge of my existence. I think for a game to be truly great, the original praise you gave it needs be reflected through your current opinion of the game. I would start looking at your past reviews, and based on whether or not you're happy with the score, you can fine tune your opinion on what makes a game great. So, maybe Brutal Legend wasn't 4.5 material after all. If you don't think it deserved a 4.5 now, use that 'mistake' of a score to encourage you to more accurately probe games in the future. I'm not saying your review of Brutal Legend was off (I haven't even played the game), but if you're unsatisfied with the score now, then yes, I believe you are "seeing these games for what they truly are now". I think your reviews are great! The fact that you reviewed Mass Effect 2 in 600 words destroys my face.
Default_picture
February 12, 2010
One more thing: I think most of us think reviews on video games are more subjective/opinion based than they actually are. Even though I see games as an artistic medium, I don't think the gray area between 'good game' and 'bad game' is that wide. Reviews of movies and music are so suggestive that their existence puzzles me; video games actually have a measure of good and bad, and it comes in the form of interaction. Games are based on computer code: something that works, or doesn't work. The subjective parts come in the form of story, art-style, etc...
37893_1338936035999_1309080061_30825631_6290042_n
February 12, 2010
@Zach That is an excellent point. I might have to write something about that after I let it marinate a bit in the ol' brain box.
Image2496
February 12, 2010
Like you said, you don't have a time machine so you have no idea how some games fare against the test of time. Personally for me, the games I loved when I first played them now have more reverance when other games can't match up to them, such as Max Payne 2, SWAT 4, or SW: Republic Commando. One game I might have overrated in my mind was Deus Ex 2 (I had not played the first game). If it's possible, don't use scores. Believe me, you'll be debating about numbers you gave for reviews for the rest of your life.
Redeye
February 12, 2010
I mostly just don't review stuff if I think I like it too much. As most of the games i really like lately are things EVERYONE is reviewing and praising. I'm not in a position where i would get paid to write that review so why write it all all if it's not going to be a unique viewpoint. As for review scores. I've been experimenting with ending my reviews with just one word that sums up my feelings on the game. I've not gotten any comments on that particular choice in the comments section in my reviews but I think it's a worthwhile system.
Me_and_luke
February 13, 2010
I went into this article hoping to talk literally about the new game smell, because it's delightful. The first thing I do when I take the shrink wrap off of a game is open it up and smell it. :D But as for the [i]actual[/i] article, I usually notice an entirely opposite phenomenon occurring. My initial perception of most games is usually "Yeah, this game was pretty decent overall," but as I reflect on the game, talk about it with other people, and continue to play more games of lesser or "different" quality (in various regards), I sometimes realize how good that game really was, and appreciate it more as time passes.
Default_picture
February 16, 2010
I've always thought about game reviewing from the terms of time travel, or maybe fortune-telling, if you like the psychic angle. It's always good to think of yourself in a year's time, looking back on the year in review. If I am inclined to give a high score, I always ask myself: When I look back on (2009, or 2010, or whatever year is in question), will this game stand out? Will it define the year, or will the game be easily forgotten? Another unfortunate worry that may hover in the back of a reviewer's brain is how the audience will react. Even with years and years of experience, I've never gotten used to the amount of mindless hate that gets spewed in my direction, most often when I give a high-profile game a lower-then-expected-by-the-fanboys score. It's never affected what I write, but it's never easy to tell people something they know they won't like hearing--or to endure the incessant and disturbing vile that so often erupts. I've heard from other reviewers that early in their career they were extremely hesitant to write something unpopular, more inclined to take the easy way out than to write what they feel and stand up for it. Alas, such is the life of a critic. I've always felt, however, that time is the great equalizer. The critic should imagine looking back in a year's time and question whether that potentially high-scoring game will hold up. Your audience, however, won't do the same, and will be quick to question your sexual orientation and your qualifications. But eventually, they'll slowly and reluctantly acknowledge how right you were when the new-game-smell wears off and they realize that maybe the game wasn't that special after all.
Default_picture
February 16, 2010
You know, I understand what you're saying, but I'm the exact opposite. I tend to be very harsh on new games when I review them, simply because I try to hold them to standards of a previous version in the series, or a game on the same system that does it better. I have a personal policy to not sit and write my legitimate review until at least three days after I beat it. At this point, I can play it afterward and try to find things I may have been too harsh on, or things I gushed too much about. I know most people think this needs to be "timely", but I am in the same boat, and don't have an endless amount of money for games. I do my best to shuffle through them each month and have a review a week, which doesn't always happen. Either way, my point is that I prefer being honest to being timely. I regret nothing more than giving a game a higher score than it deserves.
Default_picture
February 16, 2010
Ugh, forgot there was no edit button here. I meant to ask what the easiest way to get in with a paper is. Was it an internship, or just something the college was offering? If anyone is ever interested in reading my stuff (The blog feature doesn't work on this site for me, unfortunately), you can find it on Powrdup.com.
Franksmall
February 16, 2010
I stayed away from scores when I was freelancing as a reviewer for my local paper. I always wanted to make sure the text was the highlight, and that readers could take what I said about the pluses and minuses of a game and decide on their own if it was worth it. At most I would say rent, skip or buy in my article in the few cases where I felt like some definitive was needed to clarify my position. I tried writing scores for a while, but not sending the scores, just the text to my editor. When I went back and looked a few months later I also saw that I was inflating new games scores and decided it would be best to stay away from scoring entirely. I think Rob also hit the nail on the head in his introduction about games getting scores just because it is perceived that is the score before the game ever gets played. Heavenly Sword, Killzone 2, Halo 3, Mass Effect 1 all come to mind as games that got inflated scores because of their hype. I still think my Mass Effect review is one of the few that got it right when the game first came out ([url]http://www.1up.com/do/blogEntry?bId=8535440[/url])and I think Bioware would agree with me since they changed everything I complain about for the second (much better) game. Not that I am a better reviewer than everyone else... I just didn't let the hype blind me on this game. Others have totally tricked me into buying the hype. Kids games are also habitually scored lower simply because they are kids games... not that many do not deserve the scores they get. The weakest scoring is from places like Game Informer. While I really like that magazine, they are basically using a 5 point scale. They almost never give a game below a 5, and they consider 7 to be average. I hate that type of scoring. Dave Halverson of Play is probably the worst reviewer out there in some cases. Brutal Legend gets a 10+? Give me a break! That game is better than perfect? All I can say positive about Dave is that I think he actually believes the crap he writes is true. of course I find them not putting scores in the magazine and then scoring for the website not only cheap, but also a sign that they may be willing to compromise on more than just this. Scores are a hard thing to justify, but are also one of the most popular aspects of gaming publications. That makes it a hard problem to solve. Really interesting piece that you managed to effectively discuss in a great deal less space than I am even able to use in this comment. Great job! This is one of my favorite pieces on here in a while!
Mikeminotti-biopic
February 16, 2010
When I remember that Perfect Dark Zero got good reviews on launch, I have to agree with the author.
37893_1338936035999_1309080061_30825631_6290042_n
February 16, 2010
Thanks for all the support everyone. I've been a reader of Bitmob since the very beginning, but this is the first time I've ever posted something. I'm really proud (and a little surprised) this made it to the front page. Glad to see it creating a dialogue. I think of the 31 articles I've written for the Maneater, I've gotten a grand total of two comments (one being from my mom....thanks Mom...)
Franksmall
February 16, 2010
Keep it up! If you write more pieces like this then you can count me as a loyal reader!
Normal_f3c8726ca7d523c031f09eb7d4e54430
February 17, 2010
Rogue Warrior certainly didn't get a high score because it was new.
Default_picture
February 17, 2010
I tend to go more for reviewers opinions that I respect than scores, but it's very easy to go on over to metacritic and quickly check out a game and see what the general consensus is. I think with game reviews there is such a rush to just get stuff online that first impressions matter and that there isn't always time for perspective. Not to mention that with a game like Brutal legend you were probably influenced by the Tim Schafer hype, It's on my shelf waitying to be played as soon as I finish Uncharted 2.
37893_1338936035999_1309080061_30825631_6290042_n
February 17, 2010
@Taro I can't deny that probably had something to do with it. Psychonauts is quite possibly my favorite game of all time.
Default_picture
February 17, 2010
This is a bit of a prevalent issue,whether you like the game being reviewed or not.I think for the matter is the fact that so much is usually expected of it before it comes out,and more times than naught some of that expectation falls short,but doesn't always decrease its value,at least during that time period.So reflecting on something later and realizing it really wasn't that great is normal.I know I've bought a few games that I enjoyed at first and then thought about how some aspects of it could have been vastly improved months later,and it is the same for games I didn't highly of at first.
Shoe_headshot_-_square
February 17, 2010
That's an impossible thing to do, however...having the benefit of hindsight *ahead of time*. Unless you want to review games about a month after they first come out!
Default_picture
February 17, 2010
@Dan -- It might be scientifically impossible, but I think imagining myself in the future and looking back is a helpful thought experiment, and it keeps me grounded!

You must log in to post a comment. Please register if you do not have an account yet.