Decoding virtual reality: Understanding the language of video game controls

Default_picture
Friday, February 24, 2012
EDITOR'S NOTEfrom Sam Barsanti

Steven does an excellent job here explaining why he doesn't like motion controls. It's not that they're dumb, it's that they require our brains to work in a way we're not used to. That doesn't mean they're not also dumb, though.

I never really "got" motion controls until I sat down with The Legend of Zelda: Skyward Sword and started slashing cuddly Bokoblins with erratic wrist gestures and tossing bomb flowers like bowling balls with an upward sweep of the remote.

That’s also when I realized I didn't actually like motion controls. The game wasn't acting like a game, it was mimicking real life. I remember playing for the first time and asking, "Which button swings my sword?"

A friend assured me I would figure it out, but it still wasn't obvious to me. This subtle shift in cognitive problem solving, from "press X to swing sword" to "pretend to swing sword to swing sword", is fundamentally changing the way our brains think while playing video games. As it stands now, I believe motion controls are an unnecessary distraction.


Motion controls in traditional games can make a fool out of anyone.

 

Playing video games is like learning to speak: For each new title, you need to re-learn how to communicate your will to its world. Traditional games use a "symbolic" language where you must understand each button's function, either through a manual or experimentation. Like our alphabet, the spidery letters act as symbols; they're absolute nonsense until you learn to decode them.

Motion controls speak in an "iconic" language, where the sweep of your arm resembles the sword strike on-screen. Like writing ":)" to denote a smile, the icon resembles its meaning similar to Egyptian Hieroglyphs.

Both are a means of communicating, but each have their own strengths. The non-literal nature of traditional video games is its greatest strength. Just like our language, when we code our thoughts into symbolic controls like gamepads, we are liberated to perform a wide variety actions with ease.

The strength of motion controls is a currently unrealized level of immersion, but by creating a hybrid in Skyward Sword, we actually dilute the overall experience until neither communication styles take advantage of their strengths. We cannot sword fight with the type of grace and control symbolic input provides, nor do we feel truly immersed in the reality of Skyward Sword because of the limitations of technology and breaks in the illusion. And why would you want to destroy an immersive virtual world with traditional gaming elements like hit points?

As Tom Bissell points out in his review of Dead Island, gamification is only powerful within certain contexts, and the immersion he's looking for does not require game-y conventions like levels and health bars.

"In a game about running from things that want to eat you, what is more important: the emotional experience of running from things that want to eat you, or knowing that the thing that wants to eat you is a Level 23 thing that wants to eat you? Knowing that the machete in your hand can take its head off, or knowing that the machete in your hand is capable of doing 320+ hit points of damage?"

There are two futures for both these technologies. Both are glorious, but paired together neither of these entertainment forms can reach their full potential. Ultimately, combining the immersive nature of motion controls and symbolic language of traditional video games is a hot, sticky mess and it's easy to see why. Can you imagine sitting down to read Oliver Twist, except every fourth word was a pictogram?

Oliver walked twenty (picture of a mile) that day; and all that (picture of a clock) tasted nothing but the (picture of a crust of bread) and a few draughts of (picture of a glass of water).

A classic indeed.

 
Problem? Report this post
BITMOB'S SPONSOR
Adsense-placeholder
Comments (6)
Default_picture
February 22, 2012

The mouse is a refined type of motion control. Think about that.

Default_picture
February 22, 2012

This is actually something I have probably been thinking about too much lol. But I wonder, what is the mouse mimicking? Even the analogue stick requires movement towards the right to move your avatar to the right. Would that be considered motion control? I am especially puzzled about touch screens, are they iconic or symbolic? You're thumbing through pages like you would a real book, there's even the friction of the glass! But I think that's almost the extent of our technology right now, reading a book is the easiest action to virtually reproduce. Anyways, I know we don't see eye to eye on this issue but I appreciate your comments, they've really made me re-think and evaluate my own thoughts.

Default_picture
February 22, 2012

I reread my comment and it sounds kind of condescending lol. I was just pressed on time and couldn't think about it at length myself, so i dumped the burden on you :).

Default_picture
February 23, 2012

haha oh! Thinking about the mouse, I wonder if it acts more like an analogue stick than the wii? The wii responds directly to where your hand happens to be in relation to the TV, but the mouse remains exactly where you left it. So there's a bit of a disconnect between your hand gesture and the cursor. But it does seem to blur the lines a bit.

Default_picture
February 26, 2012

You made me realize another thing I didn't like about the motion control in Skyward Sword I couldn't point my finger on before.

Before the Wii, every Zelda game had a winning combination between combat and exploration, but now -- thanks to motion controls -- the game's broken down into those two elements. At one moment, you're relaxed  and comfortable seated while wandering your surroundings; and then you have to sit straight and start waving your arms because you have to slay an annoying enemy that can't leave you alone.

I guess this is the reason why I kept avoiding many enemies if I had the chance. Both playstyles threw me away from my "confort zone" whenever I was wandering or fighting because this game can't really commit itself into doing something specially right about any of those.

Default_picture
February 27, 2012

Yeah, I know exactly what you mean. I avoided those lizard guys with the steel gauntlets all the time because they were so annoying to fight! I remember relishing the combat in Windwaker, it was so much fun! Even though it wasn't very challenging all the time. But I fought every monster! Skyward sword's combat is such a chore, like you said, you almost have two different games here. One is a relaxed pace, exploring the environment, looking around, and the other is this physically and mentally exhausting combat. The two just don't mesh very well.

You must log in to post a comment. Please register if you do not have an account yet.