They should replace review scores with "similarity" scores - how much new game resembles previous work. In that system I would usually play 3/10s but sometimes also 9/10s. Everyone would be happy, devs would know how much formulas hanging on, and how new ideas are received.
Now? I hear it is Bethesda game, so I don't care, bc I hate Fallouts > 2 and Outer Worlds, but I liked walking around in Skyrim. And still there are voices of "best game I played ever". That's confusing.
In 2007, Netflix was renowned for their rating scale.
The way it worked was they collected a bunch of demographic information on you up front, then asked you to rate every movie you had seen--whether through their mail-based delivery system, or on your own in the theater, or in your past--and assign it a 1-5 rating.
You also were asked to rate genres, and--if I remember correctly--they would occasionally hit you with pop ups like "have you seen this movie? did you like it?" or "does this look like a genre or a movie you'd be interested in?"
Every movie that you hadn't seen was then given a predicted rating, and they would list them in order at the bottom of your queue.
Their premise was the more info you gave them, the more accurate their recommendations would be (duh).
They held yearly competitions with a 1 million dollar prize to anyone who could improve the formula they used, and university math departments were the main entrants.
The problem is, it's bad for business.
Every Netflix user in America had a really clear indicator of what movies they would hate.
Any company that has ratings and ALSO sells the products that are rated, has zero incentive to have "honest" review algorithms.
Now you get told what you like, and the algorithms have been optimized for control.
For your system to work, you would need to operate independently of point-of-sale, ala a site dedicated solely to demo info in, game recos out.
However, because demographic information in is a/the major factor in making recos, the current social landscape doesn't lend itself to this type of system anymore, as half of the gaming community thinks their demographics are changeable.
