Is it possible to say "I told you so" to yourself.
When I launched my new restaurant rating site about 2 and a half months ago, I made a decision. I decided to allow users to participate in the site without creating an account or logging in. This was calculated; The site will only come alive and be successful if users participate, so I wanted them to be able to interact without the hurdle of having to create an account. To give them value while asking for little in return. The same reason people can rate a restaurant or menu item without having to write about it.
Of course, this openness has an interesting side effect. I'm finding that some folks are rating restaurants with 10s across the board (the restaurant owners perhaps?). Now don't get me wrong, I don't mind. I'm just glad people are beginning to participate. Of course, this isn't exactly an unbiased view of an establishment's fare.
Eventually, I will implement an IMDB style mechanism so the ratings are only displayed when multiple ratings are collected. For now, thought...it's a free-for-all. It's actually a good play by the owners. A top-ten rated dish for a city appears on the home page giving a little extra exposure.
What do you think? Will people pass the site by if the ratings are obviously skewed? Should I do something to stop this at the risk of collecting less data? What would you do?