Separator
Honesty In Game Reviews: Is it Efficient?
Mario_cap_avatar
Thursday, August 26, 2010

Editor's note: I've always felt an obligation to readers to play a game to completion before reviewing it. I do see where Eddy is coming from, but I always have a lingering thought that until I get to the end, I still might not have seen something significant to the game. One thing I am sure of, however, is that honesty is always the best policy, even if it garners some undesirable feedback. Where do the rest of you weigh in on this issue? -Jay


I recently caught up on Ben "Yahtzee" Croshaw's 2010 Zero Punctuation videos and found myself wondering if I might actually agree with a dismissive statement he made. For his review of Final Fantasy 13, he could only muster himself to play it for a much shorter period of time than many would expect. He prefaces his review by saying, "So for what it's worth, here's a review of the first five hours.You might call that unprofessional. I call it efficiency."

Zero Punctuation

Normally, my problem with Yahtzee is that he really does seem to be genuinely pessimistic and narrow-minded, while I prefer my game culture discussion to be optimistic and analytical. Even if it's all just an act, like the Angry Video Game Nerd (who's actually a pretty nice guy, I hear), many of his followers take his words to be 100% true despite his clear intention of humor. He's hilarious, no doubt, and I can't watch a single one of his videos without literally laughing out loud at least once. However, his entire act is based on hyperbole. This works brilliantly because he nurtures seeds of truth into trees of hilarity. He's clearly intelligent and thoughtful, but he seems to also enjoy wading in the crass and dirty. While I do love his work, it is comedy. Truly looking at the games medium with such an eye of pessimism would disable us as a culture from appreciating this art form.

Now, here's the thing: In this case, I totally understand where he's coming from. I reviewed Final Fantasy Crystal Chronicles: The Crystal Bearers earlier this year and could only stomach five hours of the game before I had to put it down. The game was not actively horrible; I just didn't feel that the fifth hour provided anything genuinely different from the first four. I was just spinning my tires in place. If I wrote my review after the first three hours it would've been the same, and I have a feeling this would have likely held true even if I played it for ten. The process was similar to playing a puzzle game for review, encountering all the gameplay modes, and realizing that all you have left to enjoy about the game is the actual experience of playing it.

 

With Crystal Bearers, though, it seems that the developers intended for me to keep going through the same mediocre motions for the sake of the story -- which, unfortunately, failed to grip me in any way. I got a lot of heat over my review because I did not finish the game, but I feel that if a game leaves me completely disinterested after five hours of playing it, this very fact speaks volumes. The problem I face is that readers criticized my review not for what I wrote, how I phrased it, or anything concerning my style, but solely for the fact that I was honest about not completing the game. Mind you, this was a fact that I did not have to divulge; many reviewers are not as forthcoming.

Let me be clear: not all professional game reviewers actually complete all the games they write about. However, before you try to tell me this in unacceptable, please consider the perspective of the writers. If you feel reviewers must complete a game, any review of World of Warcraft is automatically invalid because it has no defined ending. How many hours must one play of Tetris Party Deluxe to write a "legitimate" review? Three? Five? Ten? Do I need all 240 Stars in Super Mario Galaxy 2 to have an educated opinion? What difference does it make? Ultimately, why should it matter if someone plays a game to completion if the last twenty hours did not impact their review in any way? If their efforts at arbitrarily adding that bullet point of "I finished the game" only served to kill more brain cells and require more energy drinks to stay awake long enough to finish it, then what good is it doing anyone?

The point I'm attempting to grasp at is this: I think Yahtzee may be right for a change (the only other time I agreed with him was when he said that Shadow of the Colossus is 'damn good'). Maybe we as game reviewers -- amateur, professional, or whatever -- should be honest and upfront with our readers. How long did you play that game? What difficulty setting and control scheme did you use? Did you spend time with the extra modes such as competitive online or co-op? So many of these details are clearly left out of professional reviews, and yet they can certainly impact what a reader might think and what the critic thinks. Yahtzee, for example, only ever reviews single-player components of his games but he is truthful about this fact. So, if he dislikes Modern Warfare because he thought the campaign sucked in his, maybe his review isn't very helpful to you if you really like online multiplayer.

Here's my hesitation, however: my efforts at being honest only seem to gather more flames and hate than anything else. I recently reviewed Transformers: Cybertron Adventures and admitted to actually deriving some pleasure from Michael Bay's interpretation of the franchise. A reader commented that they stopped reading when I indicated that I "only started being a fan because of the Michael Bay movies." That is the truth, though. I got burned for being honest, despite my opinion being no less relevant or valuable. Is this good or bad? Being honest inevitably means more narrow-minded readers will refute what we say, but it also means that we can distinguish our review from others out there to provide a more specific and, ideally, helpful review. But is it worth it?

It's pretty frustrating and discouraging when I feel like I could have left my Crystal Bearers review exactly as it was but merely omitted how long I spent playing it from the text and magically the same words would hold more legitimacy and none would be the wiser. This means that if we truly want game reviewers to be more efficient in reviewing games and be straight with us, we as readers need to be realistic in what we expect. Instead of deciding "This person played Final Fantasy 13 for only twenty hours of their life, their opinion is garbage!" we need to acknowledge that they formed an opinion based on the amount of time they played it. Then we need to make a decision as to how useful this opinion is instead of completely dismissing it. If the first few hours of a game fail to motivate a reviewer to continue playing, that should be a sign in and of itself, while a game that keeps them hooked for forty hours should consequently illustrate through example that they enjoyed it. It's the content that the critic experienced and how well they convey that experience that should matter. If reviews were honest with these facts it could potentially be more efficient for everyone.

I'm by no means saying "Hey, let's never finish games for review. Who cares?" because that's just lazy. I do force myself to finish even bad games from time to time -- but only when I feel motivated enough to do so or because they change just enough that I feel I might miss out on something worth commenting on otherwise. Sometimes, though, enough is enough, and our time is better spent starting to review something different instead of forcing ourselves to slag through hours of repetition that will change nothing we write.

Next time you read a review at IGN, GameSpot, 1Up, or Bitmob ask yourself, "Does it matter how long they played this game, what modes they played, or whether they played multiplayer or not?" I feel that the only reason the gaming community holds such unrealistic expectations of game reviewers is that most of them do not do a good job of disclosing this information up front. If both sides were more honest and realistic, we'd all probably enjoy game reviews a lot more.

 
12
BITMOB'S SPONSOR
Adsense-placeholder
Comments (14)
Scott_pilgrim_avatar
August 16, 2010


*Claps* Excellent post! I'm tired of readers who seem to naively think "professional review" means "unbiased." Of course, it's biased! An excellent example can be seen in the way Yatzee tends to review RPGs, most of which he despises. What didn't work for him in Demon's Souls (and subsequently led him to quitting after only playing two levels) made me love the game! That doesn't make his review any less valid; it was just his experience! And now "professional review" is really that different. If the reviewer likes RPGs, chances are they're forgiving of grinding, where an FPS fan may find that too tedious.



In point of fact, I really think that games journalism needs to move away from the review format and more towards op-ed. For one, playing a game is like taking a journey, and asking someone to rate their experience of a game is akin to asking a travel writer to rate Budapest. For this reason, I've sort of tried to embrace my own bias towards games in my reviews. And you're right, this tends to get me very few hits and some flames, but I actually feel more satisfied with those pieces. Perhaps we should start a club/support group, haha!


Mario_cap_avatar
August 16, 2010


I couldn't agree more - the whole purpose of a review, I thought, was to express your own opinion. There is no way to scientifically measure the quality of an experience. I do think that, in general, we say "This game has good pacing, but bad art design" or "this game's controls feel like garbage," etc. There is some science to it as there is in any creative medium, such as how structure of format can affect visual-based art (like the rule of thirds, etc.) but ultimately, savy gamers can pick up on these things by watching soem footage.



I don't take Yahtzee's reviews seriously because of how unrealistic he acts in them, but they're extremely valid for what they are: humor pieces meant to nitpick to the extreme. I think he's too unforgiving but that's the whole point of his schtick. I try to make sure my own experience and opinion come through in my review while also trying to be objective to a degree. In my opinion, "professional" critics need to find a balance between being objective and biased at the same time in the right balance.


Scott_pilgrim_avatar
August 16, 2010


I don't take Yatzee's reviews seriously, either, but I do have to credit him with opening my eyes to serious video game critique. I know that sounds oxymoronic, but his reviews helped me see through my own fanboyishness to some glaring problems in most games I play. I think he's given me a keener eye.


Mario_cap_avatar
August 16, 2010


@Ben



Certainly, that makes perfect sense. As I said, pretty much all of what Yahtzee says is based in truth. He's clearly intelligent and perceptive, he just chooses to go for the comedy spin. The thing to keep in mind is that no game is perfect. Many of Yahtzee's complaints ultimately don't affect the main feeling critiques will have about some of the games he reviews because they're blemishes on gems. Other times, though, he'll take a game a lot of people are already upset with and just hammer the CRAP out of it. xD


Default_picture
August 17, 2010


Hundred percent with you. A few months ago around these parts without reading anything, I reviewed a game without playing any of it (and hit the metacritic pretty much on the head btw).



Most game criticsdon't approach a game the same way a consumer would, and as long as there's full disclosure, I don't mind reading the views of someone who gave up on a game as long as they say why. I think Joystiq did it quite well with Velvet Assassin a while ago, and it happened all the time in the good old magazine days of Amiga Power, Your Sinclair and the like.



That said, Yahtzee and James can't really be classed as reviewers or critics when in character, they have their shtick and gimmick and you take what they say with a pinch of salt. Check Classic Game Room on Youtube for the just as entertaining but polar opposite in terms of happily embracing everything view.


Mario_cap_avatar
August 17, 2010


@Chris



I agree completely, but that's my beef: some people actually DO take Yahtzee seriously. Mind = blown to TEARS. It makes no sense.


Mikeminotti-biopic
August 26, 2010


Yahtzee lost me once he said that Super Mario Galaxy 2 was uncreative.


100media_imag0065
August 26, 2010


Personally, I have a very good idea of how I feel about a game about halfway through. When I played the 4 and a half hour long Modern Warfare 2, I knew at the two hour mark I did not like it. I continued playing, and at the end I still did not like it. After about 7 hours of Fallout 3, I knew I loved it. At the end, I still loved it. I honestly can not think of a single time that halfway through a game I suddenly stopped hating it or loving it.



I don't see a problem with this as long as it is presented to the readers. If they come right out and say "I only played about half of Modern Warfare, and it is a 9.5" people are going to be fine with it. If the same reviewer instead said "I only played half of Modern Warfare, and it is a 5.5" suddenly we will have problems. I don't think it matters how long a reviewer plays the game or how much attention he gave it because the only thing that truly matters to the large majority of the gaming community is what score the reviewer gives it.



It does not matter how he came to get that score, because anything he says is going to be picked apart. I have seen reviewers smashed in the comments for saying things like "I could only play a few matches online since the game isn't actually out yet and not a lot of people are on the servers". This reviewer got torn apart for admitting that he was only able to play a few matches, people assumed his opinion on the ENTIRE game was now worthless.



To them I say, is Roger Eberts opinion on Scott Pilgram vs. The World now worthless because he took a bathroom break in the middle of the movie?

Mario_cap_avatar
August 26, 2010


@Mike



Ohhhh yea. He probably said that at some point, didn't he? xD



@Ed



Yup, I'm the same way. Unless a game gives me reason to believe my opinion will change within 5 hours I usually get burned out. Now, mind you, I review games in my free time. If it was my JOB I'd be more obligated to complete games. But it's not, so I feel it's a waste.



The online gaming community is fierce, they expect a lot of unrealistic things from reviewers. I'm learning to be cool with that and acknowledge that no matter what I do, I'll never make everyone happy and I just gotta suck it up and deal with it.


Inception
August 26, 2010
I can usually tell within an hour or two if I'm going to enjoy a game. I feel that if a reviewer has had a substantial amount of time to play a game to get an understanding than it's fine by me.

Great article!!
Mario_cap_avatar
August 26, 2010


@Keenan



Thanks. And yea, usually I feel the same way. RPGs are the exception as they can always pull wildcards on you. My main issue with RPGs is that too many take too LONG to get rolling. Case in point: FF13. That game took like 8 hours until it had me genuinely interested in the gameplay, but at least the story held my attention. Crystal Bearers had neither going for it in my opinion.


Default_picture
August 27, 2010


Wonderful article Eddy!  People like to pretend reviews are arbitrary scores spat out by machines, but the reality is that someone with their own impressions and history of and with videogames sat down and made that review.  You CAN set aside your base preferences, but we all have biases in gaming that are inseperable.  Rather than looking to find someone without ANY bias at all, readers should find a reviewer they agree with the most, or (like I do) follow a community of different reviewers.


Mario_cap_avatar
August 27, 2010


@Daniel



I completely agree and that's what I do, too. I always check to see WHO wrote a review, not just the site that reviewed it. The only exception is GameTrailers and I don't think their vids tell you who wrote the review.


Default_picture
August 30, 2010


I wanna agree with the premise that if reviewers were more honest about their policies about their reviews, it would bring down the flaming and unnecessary comments. But, here's the thing: Games do change in the middle and end. Example: Bayonetta is one of my favorite games in 2010, and if I was on a site, it would be my game of the year. Now, if I based that on a small amount of timem which is usually in the beginning, it possible my impressions are missing some flaws and surprises that do occur in game, like the fact that one of the final levels repeats numerous boss battles in the same area, which is just padding out length.



Pacing and mechanics do change as well throughout the games and game reviewers have to pick up on it. Another example: for two years I hated Super Metroid because I got stuck in one area. I knew which way to go but in the days of pre-GameFAQS, I was clueless on what tools to use. Once I got past it, I beat the game and kept playing it repeatedly and it instantly became one of my favorite games of all-time.



I agree that some games are just way too long to play til completion, but another reason to play games to completion: Critics in other fields do it. Comparing apples to oranges is pointless because movies, albums, and books are quicker to digest than games, but in order for game critics and journalists to be credible to their readers and fans, they have to stomach long, meandering hours on a bad game as opposed to just loving their favorite games over and over and wishing all games were like their favorite game-that's what fanboys do. Roger Ebert is one of my favorite critics, period, not because he gives honest assessments of, but because he actually goes through movies completely. It may be time for reveiwers to stop being fans and be actual reviewers.



Final point: The whole scoring thing is hurting reviews and games than it helps. All it does is say some games aren't good as other games and only a few are worth anyone's time. This mindset pervades into reviews and it's really deceptive. I believe that a puzzle game I can download for 5 dollars on any systems and play repeatedly past the 100 hour mark is equally entertaining than a big-budget action game with a bunch of bells & whistles. Why not just use smaller scales that says a game is good or bad?

You must log in to post a comment. Please register or Connect with Facebook if you do not have an account yet.