Video Game Review Grading Scale

[Wolf Kanno]

Am I the only person who looks at the numbered grade scale on review sites like Metacritic like you do for school grading curves. You know you see 50/100 and think "I'll give that a pass" or do you view them differently?

[Jiro]

I wrote a paper on this.


High scores: How game scores affect and damage the industry
Dakoda Barker
ABSTRACT: Video game journalism is developing alongside the industry it covers and critiques. Unlike film or literature reviews, an enormous amount of weight is given to the single score in a game review, as opposed to the actual content and experiences of the reviewer. The disproportionate value given to scores has led to a toxic environment for reviewers who buck the trend and has seen financial pressures placed upon developers by publishers. Problems stemming from the reliance on a single number, which is commonly and mistakenly thought to be an objective and accurate representation of a game’s true worth, are increased by a lack of uniformity or common standards, as well as an overly passionate and outspoken fan base. A solution to the problem, based on thoughts from gaming journalists, and the consideration of developer and publisher interests, is suggested.

Introduction
As the video game market is flooded with more titles than ever before, thanks in part to a healthy independent (indie) development community, the job of the reviewer has become increasingly important. Gamers, adult gamers especially, do not have the time to sift through the countless new releases in order to find a game that appeals to their tastes or is worth their investment of time and money. The task falls to the games reviewer to experience, summarise, and then grade these games, giving their personal appraisal in order to guide gamers towards their next adventure.

Game reviewers, like their counterparts in film, literature, music, and so on, are viewed as authorities in their field, and are expected to provide honest comments and critiques with as much objectivity as possible. Subjectivity is unavoidable, and personal biases are easily explained within the review itself. However, the numerical score seems to be given the most weight and is seen by parts of the gaming community and gaming industry as the most important factor in a review: high scores are everything.

This disproportionate value given to review scores has created an unhealthy environment in the games industry. The personal experiences of reviewers are overlooked and stripped away in favour of the ‘objective’ scoring system—despite the score itself being a subjective and non-standardised summation of the reviewer’s thoughts about the game. Reviewers are criticised by gamers for giving a score considered ‘too low’ or ‘unfair’, and development teams have bonuses withheld for not meeting a predetermined aggregated score, regardless of other factors. Abolishing scores from reviews would remove the positive aspects of the system and make a general consensus on a game’s ‘success’ harder to calculate, but an alternative to this lopsided and anger-inducing system needs to be introduced so reviews can continue to inform.

Critics criticised over ‘low’ scores
Disagreeing with critics is not a new phenomenon. Personal preferences factor into decisions about every aspect of life—art and artistic pursuits are no different. But the ferocity and frequency of attacks on reviewers who dare to differ from the mainstream is cause for concern. Different viewpoints are integral to creating a positive and healthy discourse about a subject, video games included (Humprecht & Büchel, 2013). If everybody shared the same opinion, the entire industry—from developers to critics—would stagnate.

Therefore, attacking reviewers, in addition to being completely unnecessary, damages and weakens the discourse surrounding the industry, which is counterintuitive to the intent: defending the ‘good’ in video games. Gamespot reviewer Carolyn Petit received varying degrees of hate, including a petition to have her fired, for her ‘prejudiced’ and apparently ‘extremely feminist’ score of 9 out of 10 for satirical crime simulator Grand Theft Auto V, with her comments about the misogynistic portrayal of women—in spite of her positive comments about the complex and flawed male characters—singled out as evidence of a feminist agenda, or lack of knowledge about the game and franchise (Parfitt, 2013).

Petit is not the only victim of the angry gamer mob: feminist blogger Anita Sarkeesian received threats of violence and rape—in addition to the creation of a game where players could punch her in the face—over her YouTube series exploring sexism and tropes in video games (Rosenberg, 2012; Pinchefsky, 2012), and former Gamespot reviewer Jeff Gerstmann received death threats after giving The Legend of Zelda: Twilight Princess an apparently low score of 8.8 out of 10 (System Wars Magazine, 2013). Countless other examples of outrage over review scores exist, but every case boils down to the same problem: there is a fundamental disagreement with the rating a game is given.

With such backlash against reviewers and their opinions, often before a game has even been released to the public, it seems that a game’s score is at least partially predetermined. Critic Jim Sterling’s 8 out of 10 score for Gears of War 3 was met with confusion and outrage by gamers and developers alike. Sterling responded, saying that it is ‘utterly, completely, intellectually insulting’ that the video game industry ‘has decided 9/10 is the manifest destiny of certain games’ (2011). If the expectation is that reviewers should simply follow the crowd, then their critical role has become defunct.

The cost of a ‘bad’ score
Gamers are not the only stakeholder when it comes to review scores. Publishers want to see their game do well critically, as critical success often leads to commercial success (Chen & Xie, 2008). Developers also want something they created to be well received, not just to validate their hard work, but also because thousands of dollars could ride on the outcome.

Obsidian Entertainment designer Chris Avellone revealed via Twitter that his team missed out on bonuses totalling around $1 million because Fallout: New Vegas failed to achieve the required score of 85 on review aggregator Metacritic (Schreier, 2012). Both the Xbox and PC versions of Fallout: New Vegas hold an average score of 84, a score maintained since its 2010 release (CBS Interactive, 2013). A single missed point, based on the averaged opinions of 81 reviewers, cost each member of the Obsidian team $14,000 in bonuses.

Metacritic scores can determine whether a development studio even has their game picked up by a publisher. Developer Kim Swift, notable for working on the wildly successful game Portal, has had pitches renegotiated or turned down based entirely on Metacritic scores, costing both her and her company money and contracts (Schreier, 2012). Metacritic weights each review in order to calculate the average, but the exact formula remains a secret. While Metacritic founder Marc Doyle claims the website is there purely to educate gamers, it is clear that publishers are using it as leverage against development studios (Schreier, 2012). IGN games journalist Keza MacDonald (2012) suspects the Metacritic influence has gone too far, and could even be ruining the gaming industry.

Financial interests can also affect what score a game receives, with dire consequences for any reviewer who puts advertising revenue in jeopardy. Jeff Gerstmann was fired on the spot after his critical review of Kane & Lynch: Dead Men caused publisher Eidos Interactive to reconsider its advertising on the Gamespot website (Cavalli, 2012).

Games are both expected and required to meet high scores, with pressure placed on both the reviewers and the developers to make it a reality. The industry can only suffer if creative teams are forced to stifle new and untested ideas in favour of proven successes. Likewise, journalistic integrity is destroyed if reviewers are forced to give a dishonest but favourable review in order to keep their job. The current system is failing every stakeholder, and a solution must be found.

The four point scale
Much of the confusion and anger comes from the lack of a universally recognised metric (Ivory, 2006). Publications and reviewers use their own scales, including 1-5, 1-10, and 1-100. While these could be equated mathematically—a 4 out of 5 is the same as 8 out of 10 and 80 out of 100—the fact is that these scores are entirely subjective; games within different genres have different expectations, and a reviewer’s personal preferences and experiences undoubtedly factor into the outcome, so even two scores of 8 out of 10 are not necessarily the same (Jenkins, 2010).

This problem is exacerbated by the fact that a lot of reviewers and publications tend to use only the top half of their scale: a scale of 1-10 functions as 5-10, or even 6-10, which results in inflated scores and confusion. Instead of reflecting the scale it is using, reviews tend to favour a system similar to that of the United States school system: anything below 60% is a fail, meaning an ‘average’ game would score around 75% (Kate, 2011; Kain, 2013). With half of the scale devoted to failure, each point comes to represent a greater range of quality. Cases where a reviewer or publication uses the full range on the scale—such as X-Play, Good Game, and Hyper—are the exception, even if the scale is defined within the publication itself.

Games journalist Daniel Wilks (in Carr, 2013) says he ‘hates’ review scores, because there is no standardised way to calculate them. Each game has different criteria: music might not be an important factor in an indie puzzle game, but could have a huge impact on a blockbuster action game (Jenkins, 2010). Reviews can also be affected by the skill, experience, and time investment of the reviewer (Ivory, 2006). A single number cannot hope to convey the complexity or subjectivity of the process or criteria used to calculate the score.

Doing away with review scores is not the solution. Sterling (2012) cites several drawbacks to removing them: readers who want a simple score to gauge the general quality of a game might boycott his reviews, diminishing the influence Sterling has as a reviewer. He says the fault lies with readers who take review scores ‘too seriously’. Review scores are intended to give readers the ‘essence’ of whether or not a game can be considered ‘good’ (Pattison, in Carr 2013). Even so, what constitutes ‘good’ is still subjective.

Review scores themselves are harmless, and an easy tool to communicate a general impression, not an inflexible, scientifically calculated, objective rating—which seems to be the point of most confusion. If review scores are an important and inevitable part of games journalism, what can be done to ensure scores are being interpreted correctly?

Saving the games industry from itself
A simple solution does not exist. Review scores are entrenched in contemporary games journalism, and are seen as the authoritative and objective mark of a game’s worth and success. Gamers have become invested in the success and failure of their favourite game series, regardless of the actual quality of each instalment, to the point where reviewers are vilified for going against expectations.

A universal metric would remove discrepancy, and give standardised criteria for which to judge games. However, a single metric is impossible to apply to such a diverse field; even a scoring system unique to each genre would encounter problems with games that combine multiple genres, create a new genre, or are simply unclassifiable. Critics would also be further burdened with trying to adapt their personal experiences and biases into a rigid system, attempting—however impossibly—to strip away one of the most important aspects and benefits of a diverse reviewing environment: subjectivity.

The responsibility lies with the individual. Publishers must understand that Metacritic scores are not the ultimate marker of a game’s success. Gamers must understand that review scores—both individual scores and the Metacritic average—are not objective and are not a personal slight against the game or its fans. Reviewers should be able to give their honest opinions, and the diversity of reviewers should represent the diversity of the community they serve. Readers should find a reviewer that entertains, informs, and aligns closely with the reader’s tastes and preferences, and realise that it is impossible to make the perfect game.

The adventure continues
Compared with literature and film, gaming is still an industry in its youth. As such, it is still growing and developing as technology advances and gaming itself becomes a mainstream pursuit. The heavy reliance on review scores—by both gamers and publishers—to determine the ‘objective’ worth of a game is damaging to the entire industry. Only by taking pause and remembering that everybody is entitled to an opinion, and that respectful disagreements are healthy for discussion, can gaming present itself as a mature industry worthy of respect.

References
Carr, J. (Producer). (2013, October 22). Good Game [Television broadcast]. Sydney, NSW: Australian Broadcasting Company.
Cavalli, E. (2012, March 16). Jeff Gerstmann explains his departure from Gamespot. The Escapist. Retrieved from Jeff Gerstmann Explains His Departure From Gamespot | The Escapist (http://www.escapistmagazine.com/news/view/116360-Jeff-Gerstmann-Explains-His-Departure-From-Gamespot).
CBS Interactive. (2013). Fallout: New Vegas for Xbox 360 reviews. Metacritic. Retrieved from Fallout: New Vegas for Xbox 360 Reviews - Metacritic (http://www.metacritic.com/game/xbox-360/fallout-new-vegas).
Chen, Y. & Xie, J. (2008). Online consumer review: Word-of-mouth as a new element of marketing communication mix. Management Science. 54(3). 477-491.
Humprecht, E. & Büchel, F. (2013). More of the same or marketplace of opinions? A cross-national comparison of diversity in online news reporting. The International Journal of Press/Politics. 18(4). 436-461.
Ivory, J. (2006). Still a man's game: Gender representation in online reviews of video games. Mass Communication and Society. 9(1). 103-114.DOI: 10.1207/s15327825mcs0901_6.
Jenkins, B. (2010). Staying objective: The effect of corporate public relations on video game journalists. (Masters dissertation, Louisiana State University, 2010). Retrieved from http://etd.lsu.edu/docs/available/etd-11192010-115249/unrestricted/Thesis.pdf.
Kain, E. (2013, June 14). Video game reviews: A discussion of the ten-point scale and inflated scores. Forbes. Retrieved from Video Game Reviews: A Discussion Of The Ten-Point Scale And Inflated Scores - Forbes (http://www.forbes.com/sites/erikkain/2013/06/14/how-video-game-reviews-work).
MacDonald, K. (2012, July 16). Is Metacritic ruining the games industry? IGN. Retrieved from Is Metacritic Ruining The Games Industry? - IGN (http://au.ign.com/articles/2012/07/16/is-metacritic-ruining-the-games-industry).
Parfitt, B. (2013, September 18). Gamers petition for sacking of GameSpot writer who criticised GTAV for misogyny. MCV. Retrieved from Gamers petition for sacking of GameSpot writer who criticised GTAV for misogyny | Games industry news | MCV (http://www.mcvuk.com/news/read/gamers-petition-for-sacking-of-gamespot-writer-who-criticised-gtav-for-misogyny/0121238).
Pinchefsky, C. (2012, September 7). Feminist blogger is a victim of a vicious videogame retaliation. Forbes. Retrieved from Feminist Blogger Is a Victim of a Vicious Videogame Retaliation - Forbes (http://www.forbes.com/sites/carolpinchefsky/2012/07/09/feminist-blogger-is-a-victim-of-a-vicious-videogame-retaliation).
Rosenberg, A. (2012, July 10). Anita Sarkeesian, Stephanie Guthrie, and the strategic failures of trolls. Think Progress. Retrieved from Anita Sarkeesian, Stephanie Guthrie, And The Strategic Failures of Trolls | ThinkProgress (http://thinkprogress.org/alyssa/2012/07/10/513912/anita-sarkeesian-stephanie-guthrie-and-the-strategic-failures-of-trolls).
Schreier, J. (2012, March 15). Why are game developer bonuses based on review scores? Kotaku. Retrieved from Why Are Game Developer Bonuses Based On Review Scores? (http://kotaku.com/5893595/why-are-game-developer-bonuses-based-on-review-scores).
———— (2012, April 11). Metacritic matters: How review scores hurt video games. Kotaku. Retrieved from Metacritic Matters: How Review Scores Hurt Video Games (http://kotaku.com/metacritic-matters-how-review-scores-hurt-video-games-472462218).
Sterling, J. (2011, September 15). Gears of War 3: Perfect review scores by divine right. Game Front. Retrieved from Gears of War 3: Perfect Review Scores By Divine Right | Game Front (http://www.gamefront.com/gears-of-war-3-perfect-review-scores-by-divine-right).
———— (2012, December 3). Jimquisition: Review scores are not evil. The Escapist. Retrieved from Review Scores Are Not Evil | Jimquisition Video Gallery | The Escapist (http://www.escapistmagazine.com/videos/view/jimquisition/6582-Review-Scores-Are-Not-Evil).
System Wars Magazine. (2013, September 16). Gamespot reviewer gives GTA V a generous score, readers want her fired. System Wars Magazine. Retrieved from REPORT: Gamespot reviewer gives GTA V a generous score, readers want her fired | System Wars Magazine (http://systemwarsmagazine.com/2013/09/16/report-gamespot-reviewer-gives-gta-v-a-generous-score-readers-want-her-fired).

[Scotty_ffgamer]

This is why I never put a score on my reviews I write. Of course, I understand why bigger review sites and such have scores.

[Jiro]

I always find personal comments to be more enlightening than a simple score.

[Scotty_ffgamer]

I do too, but scores are quick and easy to see. If what you want are people just clicking on your pages, you are more likely to get views or whatever with scores. That's why I understand the need to have scores if you want to generate a lot of traffic. I think it would be better if everyone did away with scores though.

[Jiro]

Oh, yeah. Scores are a necessary evil, I think. It's not standardised which leads to a lot of misunderstanding or score inflation, but scores bring in the traffic and hopefully the comments actually convince people one way or the other.

[Ayen]

I seldom pay them attention ironically enough, but if a game was to have multiple low scores from various sources I'd be less likely to check it out. I treat them like news outlets since I know those within the industry can be bought.

[Miss Mae]

I've read Jiro's essay before, so I know a lot of my thoughts are covered in that, but in short I consider the way games scores are currently being used to be incredibly flawed. For a lot of reviewers, the scale runs at a 7-10 system unless the game is absolutely terrible, at which point it might receive a 5. Because this is such a common way of using a 1-10 scale, it introduces a lot of inconsistencies when other other reviewers use all the points in their 1-10 scale (e.g. if they consider a 5/10 to be a pass rather than a dismal fail). This makes it nearly impossible to use reviewer scores to judge whether a game is 'good' or not, because it's difficult to tell where mark-0 is for the particular reviewer you are reading unless you are familiar with their work.

As said in other comments, I pay a lot more attention to personal comments than the number a game is given. The only time a score will pique my interest is if it is from a reviewer that I know well, if understand how they use their scores and generally relate to the personal preferences of. Or if a game received 10s across the board, because that usually means it's worth looking at.

[The Man]

As with everything else in life, TV Tropes has articles on this:

8.8 - Television Tropes & Idioms (http://tvtropes.org/pmwiki/pmwiki.php/Main/EightPointEight)
Four Point Scale - Television Tropes & Idioms (http://tvtropes.org/pmwiki/pmwiki.php/Main/FourPointScale)

And, of course, there's an xkcd for it too:

http://imgs.xkcd.com/comics/star_ratings.png

Scores are ok if the reviewer explains how they grade things on their site, but they probably get too much attention on the whole. I haven't read all of Jiro's article yet but I suspect I'll agree with a lot of it.

[Slothy]

On my phone right before bed so I'll read Jiro's article later. I'm sure it probably says a lot of things I'll agree with though.

But I will say there's a reason why there's a general consensus that game reviews run on a 5-10 scale at best. It's because it's largely true. Unless you're familiar with how a specific reviewer grades a game the score is useless, and most don't know the numbers 0-4 even exist.

[Dr Unne]

What about this theory: There are a lot of games that would get 1-5 scores on the 1-10 scale, but no one bothers to post reviews about them because they're so bad that they aren't worth the time. Maybe the 1's are all Flash games made by 10 year olds.

[Jiro]

A lot of reviewers are getting paid per review or per traffic, so not posting a review about a game you've played would be counter productive. Might as well monetise everything you do.

[NeoCracker]

I liked Bilstered thumbs set up, where they would both rank the game 1-10 and qualify it with a 'For Fans Only' or 'Try it out'.

[Shauna]

I don't pay attention to reviews anyway.

[Madonna]

Game review scores? What? I do not look for potential games to own in review sites/magazines, but rather keep an open ear for potentially cool games. I wait for gameplay trailers and Let's Play videos. I am cool with game previews to hype up a game, and am down with consumers' gameplay videos to help confirm desire. I prefer to go with a "Is it fun/good?" angle than an arbitrary number metric.

[black orb]

>>> what? A review without a score is just.. pointless..
and reviews had saved me from wasting money on crap games many times (like 5 times just this year)..:luca:

[Kalevala]

I, like most people in this thread, am not a fan of review scores. Use your writing to communicate to me your thoughts on the game, don't throw a number at me or use it as a crutch. I like that GameCritics include scores at the bottom of their reviews as plain text that must be highlighted in order to see.

[Dat Matt]

In regards to reviews, I tend to ignore them. This is for 2 main reasons.

1. Reviews are based on personal opinion. For example, I could rate the new Mario Kart Game as 11/10, but someone playing the game with me could score it as a 5. The average would be 8 despite the fact I really enjoyed it, and the other person thought it was just average.

2. Review Scores tend to be wonky, and players take these score to heart. Recently, the guys over at Edge Magazine gave Yoshi's New Island a 5/10. The people who read this review on /r/nintendo exploded because someone dared to criticise a game the might like. There were even talks of people boycotting the magazine because of this low score. People played the game when it came out, and they agreed with the score. It was a generally mediocre game when compared to the originals. Didn't stop anyone throwing a tantrum when someone didn't like that they liked.

No one should award games a 10/10 score. This means that there is no room for improvement in the game and there are no flaws. Every game is flawed in some respect, be it run time, difficultly, glitches. At the same time I've seen reviews for games (lets say Alone in the Dark 360/PS3) scoring in at 8/10, 7/10 despite being a horrible broken mess of a game. I can generally grasp if I'll like the games based on trailers and screenshots of the game. The reviews however don't mean anything to me anymore.

[Ayen]

Personally, I'm not surprised when I don't see the numbers 0 - 4 crop up that often if at all because I generally can't think of many games that would score that low. I've been reviewing for three years and there's only been two occasions where I scored something under five, which is below average for me.


No one should award games a 10/10 score. This means that there is no room for improvement in the game and there are no flaws. Every game is flawed in some respect, be it run time, difficultly, glitches.

Several months back I would have agreed with this, but I've played a couple of games since then where I couldn't think of anything negative to say so they got a ten by default. If you can't think of anything bad to say what are you supposed to do?

[Dr Unne]

In regards to reviews, I tend to ignore them. This is for 2 main reasons.

1. Reviews are based on personal opinion. For example, I could rate the new Mario Kart Game as 11/10, but someone playing the game with me could score it as a 5. The average would be 8 despite the fact I really enjoyed it, and the other person thought it was just average.

Averages and aggregates are ignorable, but reviews can still be valuable. I've heard some reviewers make the point that for reviews to be useful, you should find a reviewer that you personally tend to agree with. Which is what I try to do.

Like when I want to know if a new RPG is good, I'll ask a friend that I know enjoys RPGs and has enjoyed many of the same ones I've enjoyed in the past. Their opinion will probably be relevant. Similarly I'll try to find a reviewer that seems to like the same stuff I like, and keep coming back to them.

[Scotty_ffgamer]

Most games I get I don't read reviews for just because the games I get lately are generally for things I would be buying anyways probably. If there is a game (or anything really) that I'm unsure of, I like to look at at least 1 professional review and then a few reviews on places like Amazon from the low end, middle end, and high end just to get a sense of the details that stuck out to people. That can give me a fairly good idea on if I'll like it. While I don't like scores in general, it does make it easy at a glance to see the trending scores people give, and it makes it easier to find the types of reviews I'm looking for.

[black orb]

>>> Incredible how people waste money here, games are not cheap you know..
If you dont like reviews atleast rent the games first..:luca:

[Miss Mae]

Personally, I'm not surprised when I don't see the numbers 0 - 4 crop up that often if at all because I generally can't think of many games that would score that low. I've been reviewing for three years and there's only been two occasions where I scored something under five, which is below average for me.

This is what a lot of reviewers do, and this is why the scoring system is skewed. If people are using a 0-10 scoring system but aren't utilising the 0-4 range for the worst games they look at, the scores are weighted to the top end. This means games that are scored a 5, which is 50% and should be at least a pass mark, are considered the worst games out there by readers. It also means that reviewers that do utilise their full 0-10 scale cannot have their review scores compared to those who use the weighted system, as the resulting aggregates are meaningless.

[Jiro]

Personally, I'm not surprised when I don't see the numbers 0 - 4 crop up that often if at all because I generally can't think of many games that would score that low. I've been reviewing for three years and there's only been two occasions where I scored something under five, which is below average for me.


What would a game have to do to score that low? Ride to Hell: Retribution was buggy to the point of unplayability, looked terrible, had a paperthin plot and was generally seen as an affront to gaming. The latest Rambo game is in a similar vein, being utterly bland and uninspired. What would you give those games if not below 5?

If a game is playable, that does not mean it is entitled to a 5. I also don't think we should not hand out 10s, because if you are weighting games against "THE PERFECT GAME" then most of them are probably in the negatives because the future holds endless possibilities. 10/10 means a game is near perfect or better, because perfection is subjective and nobody has a standardised scale.

What would you rate Tetris when compared to Grand Theft Auto V or Call of Duty: Ghosts? Tetris has shit graphics, repetitive music that relies on nostalgia, has tight but extremely limited and repetitive gameplay, and there is no chooseable gameplay difficulty or customisation options. Tetris also has no campaign, no multiplayer, and no free-roaming ability, let alone dialogue. 0/10.

[Ayen]

Personally, I'm not surprised when I don't see the numbers 0 - 4 crop up that often if at all because I generally can't think of many games that would score that low. I've been reviewing for three years and there's only been two occasions where I scored something under five, which is below average for me.


What would a game have to do to score that low? Ride to Hell: Retribution was buggy to the point of unplayability, looked terrible, had a paperthin plot and was generally seen as an affront to gaming. The latest Rambo game is in a similar vein, being utterly bland and uninspired. What would you give those games if not below 5?

If a game is playable, that does not mean it is entitled to a 5. I also don't think we should not hand out 10s, because if you are weighting games against "THE PERFECT GAME" then most of them are probably in the negatives because the future holds endless possibilities. 10/10 means a game is near perfect or better, because perfection is subjective and nobody has a standardised scale.

The way I calculate my numbers isn't the same as other critics. I subtract by the cons. Every game I look at starts at ten by default until I find a con worth noting. A game would have to have ten cons or more to get a 0/10 from me and I'd have to play those games you mentioned in order to tell you how they'd rate. It isn't a perfect system and for a while I stopped using numbers altogether until last September. But it's worked for me in the long run.


What would you rate Tetris when compared to Grand Theft Auto V or Call of Duty: Ghosts? Tetris has trout graphics, repetitive music that relies on nostalgia, has tight but extremely limited and repetitive gameplay, and there is no chooseable gameplay difficulty or customisation options. Tetris also has no campaign, no multiplayer, and no free-roaming ability, let alone dialogue. 0/10.

Games are rated on a case by case basis for me. The only times I do comparisons is when the game is a sequel or a part of the same genre.

[Jiro]

"For me" is a key phrase there: not everyone follows these standards. There is no universal standard, and as such, something like Metacritic is inherently flawed because the data it uses is inconsistent and unevenly weighted.

How do you determine what is serious enough of a flaw to dock marks? What aspects do you favour? The problem with giving an objective rating like a number to a subjective enterprise like a video game review means that the number is a suggestion at best.

And if Loony BoB's (or anybody's, given the variability in those lists) Top 100 games is anything to go by, a marker of a game's greatness does not equally translate into the amount of fun it generates for a person.

[Ayen]

"For me" is a key phrase there: not everyone follows these standards. There is no universal standard, and as such, something like Metacritic is inherently flawed because the data it uses is inconsistent and unevenly weighted.

Yeah, I get what you're saying.


How do you determine what is serious enough of a flaw to dock marks? What aspects do you favour? The problem with giving an objective rating like a number to a subjective enterprise like a video game review means that the number is a suggestion at best.

It depends on the game. The only things I can think of off the top of my head that can apply for any game would be glitches and I tend to lump glitches together as one minus.


And if Loony BoB's (or anybody's, given the variability in those lists) Top 100 games is anything to go by, a marker of a game's greatness does not equally translate into the amount of fun it generates for a person.

Burn on Loony BoB!

[Miss Mae]

How do you determine what is serious enough of a flaw to dock marks? What aspects do you favour? The problem with giving an objective rating like a number to a subjective enterprise like a video game review means that the number is a suggestion at best.

It depends on the game. The only things I can think of off the top of my head that can apply for any game would be glitches and I tend to lump glitches together as one minus.


This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

[Ayen]

How do you determine what is serious enough of a flaw to dock marks? What aspects do you favour? The problem with giving an objective rating like a number to a subjective enterprise like a video game review means that the number is a suggestion at best.

It depends on the game. The only things I can think of off the top of my head that can apply for any game would be glitches and I tend to lump glitches together as one minus.


This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

I haven't encountered this situation so I can't say. The first game I reviewed where glitches were mentioned was Dark Souls, and the glitches were more of a WTF than game breaking. Arkham Origins had on three separate occasions bugged to the point where I had to restart the game, but I thought the auto-save feature was a redeemable addition to combat this and it didn't happen often. Assassin's Creed III had a couple of glitches that ruined sidequests and moved your character into position for the plot to play out ruining immersion into the story and I separated those by two. Though that's mainly because I wasn't sure if the latter counted as a glitch or not. I may have to reevaluate my system.

Or give ET a 9/10 and unlock the Ultimate Trollage achievement.

[Kalevala]

This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

What would such a game look like? Something with brilliant writing and gameplay concepts that just so happens to be horribly glitchy? The idea of this is interesting. Can you think of any examples?

[Miss Mae]

This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

What would such a game look like? Something with brilliant writing and gameplay concepts that just so happens to be horribly glitchy? The idea of this is interesting. Can you think of any examples?
I don't have a specific example - it was just a hypothetical. Same question applies to the other areas you listed - if the gameplay is so horrendous that the whole game is painful to play, is that still only one flaw by ToriJ's system and could the game still get a 9/10? I was just playing devil advocate. :) I'd be interested to see if games like that in my hypothetical exist though.

[Jiro]

The Final Fantasy VI mobile port had an error that made it impossible to complete. Battlefield 4 had game ending bugs through several of its patches. SimCity launched and its online server made it unplayable for many people who shelled out for it.

[Miss Mae]

Jiro saves the day with good examples that did not pop into my head. Thank you kindly.

[Jiro]

There are probably more examples. I know that my copy of Skyrim glitched, making one quest chain impossible to finish. That's a less drastic example, but these are still problems that alter the product we are purchasing in a negative way.

[Kalevala]

If it's a glitch or glitches that stretch beyond a single copy and renders the game impossible to complete then it shouldn't be able to receive a 9/10, unless not being able to finish the game was a design choice that has something to do with the game's message. I can't picture a film that cuts off midway through being able to receive a similar grade.

[Miss Mae]

If it's a glitch or glitches that stretch beyond a single copy and renders the game impossible to complete then it shouldn't be able to receive a 9/10, unless not being able to finish the game was a design choice that has something to do with the game's message. I can't picture a film that cuts off midway through being able to receive a similar grade.
I agree with you. It was a question directed at ToriJ's specific method of scoring games when he reviews them (and I suppose any other people who score games in this way). It was designed to highlight the flaws in the scoring system. And, after discussing, he did agree that his scoring system may need reviewing. :)

[Kalevala]

Oh, I didn't think you were stating the opposite. I was just curious if there were any mass market games that fit that specific description and decided to add my two cents. We're on the same page. :p

[Miss Mae]

Excellent :jess:

[Botchmun]

3 full pages of people talking about arbitrary and usually skewed numeric values on games... TL; DR! If only there was a numeric value to summarize every post in this thread. 8/10! ...more like hate/10



This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

What would such a game look like? Something with brilliant writing and gameplay concepts that just so happens to be horribly glitchy? The idea of this is interesting. Can you think of any examples?

You stupid eyepatch dog. Do you even Goat Simulator?

[Miss Mae]

Goat Simulator, with it's brilliant writing and gameplay concepts? :hahaha:

However, this is also a good point. Goat Simulator doesn't follow any of the typical rules for what makes a 'good' game but has sold an outrageous number of copies considering what it is.

[Bolivar]

I feel guilty because I like scrolling to the score at the end but it's that mentality that generates the clicks and keeps this problem going.

I agree you should pay more attention to the text of the review but the sad truth is, a lot of reviewers tailor the content of their review to justify the review score. You can see how with most high profile games, the big journalists are usually trying to "make a point" with their review. It just happened with Titanfall, the major outlets were heavily criticized for the cascade of 9s and 10s that ignored or trivialized some of the obvious issues and omissions with the game. The more independent sites gave it a more sober appraisal and kept the meta average out of the 9-10 territory it initially looked like it was heading for.

Recent hiccups aside, I do think the media is starting to use more of the scale as of late.

[Slothy]

Battlefield 4 had game ending bugs through several of its patches.

Unless I'm mistaken the game is still filled with massive glitches to this day. Maybe not game ending anymore though. Never played it myself.

[Kalevala]

3 full pages of people talking about arbitrary and usually skewed numeric values on games... TL; DR! If only there was a numeric value to summarize every post in this thread. 8/10! ...more like hate/10



This is interesting to me. If a game has so many technical glitches that it is practically unplayable, are they considered to be only one flaw? Is that game still eligible for a 9/10 by your system?

What would such a game look like? Something with brilliant writing and gameplay concepts that just so happens to be horribly glitchy? The idea of this is interesting. Can you think of any examples?

You stupid eyepatch dog. Do you even Goat Simulator?

Goat Simulator doesn't have brilliant writing and most of its gameplay concepts are taken from the Tony Hawk franchise.

[Jiro]

Battlefield 4 had game ending bugs through several of its patches.

Unless I'm mistaken the game is still filled with massive glitches to this day. Maybe not game ending anymore though. Never played it myself.

I haven't been able to play it much. Dropped full fare on the game and got nowhere near the time out of it as I wanted because it went from glitch to game ending bug to such intense server lag. Now I get admin booted from every game for "High ping" but the servers are too shit for me to go any faster.

[Del Murder]

I think the '7-10' scoring system is stupid. I do put stock in review scores because I am a numbers guy and having a uniform rating system helps me process information. Of course the text of the review is also very important but who has time to read all these reviews? It's just silly that we live in a world where a 7 score is a 'bad' game and the difference between 9.25 and 9.5 is bigger than the difference between 4 and 6.

[Formalhaut]

I think the '7-10' scoring system is stupid. I do put stock in review scores because I am a numbers guy and having a uniform rating system helps me process information.

I'm a numbers guy as well. I like to keep things in boxes, so to speak. I know where I stand with a 'seven', or 'eight'. At least, my interpretation of those numbers anyway.

The thing with me is that I have played many games that are simply 'better than the sum of their parts'. Take Dynasty Warriors, for example. These games would never get a very high score on mainstream review sites. Like, a seven, even a six perhaps. However, I really love those games, no matter the scores. They are never going to be 'amazing', but I love them nonetheless.

Reviews are useful. I like them. If there's a game series I haven't played before, I'll read them, but if I'm pretty devoted to a series, I'll buy that game regardless. Personally, I quite like trying a game out first, or at least seeing someone else play it first and see if I get that 'feeling'. It's hard to describe, but it's a feeling you get when you know you're going to enjoy that game. That beats any review, in my opinion.

[Jiro]

It all depends on how you weight aspects. I find it strange that fun isn't the main feature for mainstream reviewers, because you would think people want to know what is enjoyable.

[WildRaubtier]

Considering how popular ff6 is around this joint it's surprising to see someone wonder why fun isn't a bigger component of scores. </easy target>

[Jiro]

Final Fantasy VI is both brilliantly constructed and thoroughly enjoyable so I don't know what you're talking about :ffviwag:

[WildRaubtier]

"Push X to have fun" only works for Dynasty Warriors, sorry.

[The Man]

good thing that's not an accurate summary of final fantasy vi then