Your comments about slashdot and epinions are interesting -- but as a dotcom exec who got it (
http://www.emerchandise.com/ is still selling pop culture swag, thank you all!), I'm also fretting about the *unmoderated* *unrated* reputation managers out there.
In specific, BizRate.com does us a great service by getting customer feedback on our sales and fulfillment. At the same time, every response is rated equally, and no real guidelines are given to the survey respondent on how to rate.
The only weighting BizRate uses in your scores is the "what you done for me lately" algorithm -- recent scores seem to be weighted heavier. In a volatile online market this makes sense -- your quality of fulfillment today isn't the same as it was a year ago, so recent responses have more relevance to future predicted performance.
But what do you do when someone rates your fulfillment ZERO on a scale of one to ten because the UPS guy came by your house nine times and didn't leave a sticky note saying s/he was trying to deliver?
Although BizRate says that respondents should evaluate only on the e-commerce company's performance, this zero set our rating back from about 9.0 to about 8.5 for weeks -- just before Christmas. (We appealed to have this survey removed from the results, since it doesn't reflect their own guidelines, and they refused.)
For a company such as Amazon -- a behemoth who delivers hundreds of thousands of orders of orders in a month -- one irrational low response is evened out. But for relatively small companies such as ours, BizRate is set up to punish us disproportionately for one bad apple.
It doesn't take a long time for a user to evaluate a company on bizrate. Store ratings are up front and abstract, and most users probably only look at the overall ratings and perhaps the first screen of user reviews (which, by the way, are not drawn from surveys but from people who just arrive on the bizrate site -- which makes them vulnerable to fraud).
Don't get me wrong -- I think BizRate provides a valuable sanity check on our quality, for our own QA. But I often wonder, as an insider, how much I really can depend on their rating scheme and reviews. Good reputations such as my own company's are valid. But bad reputations can be randomly inflicted on newly rated and small companies, causing them to withdraw from the system or just to look bad interminably.
Reputation is something we value, but it can be made fragile and unreliable by less intelligently weighted systems.
Shava Nerad
VP/Marketing & Business Development
http://emarket-group.comhttp://www.emerchandise.comTV/movie/pop culture stuff