PDA

View Full Version : results of my forum metric.



Todeswulf
04-07-2013, 09:17 PM
So, I asked a good friend today who isn't a gamer but who is a specialist in analytics and metrics to do a survey of the forums and to find if the forums were in fact full of negativity or if it was more balanced than folks realized.

This is what she came up with. keep in mind this isn't a scientific poll and should not be taken as the last word, you may or may not agree with it depending what side of the fence you are on, but I thought it would spark an interesting debate.

She looked at General discussion Game play discussion and the sub forums of General PC General Xbox and General PS3.

The amount of positive post were 44%
The amount of negative post were 38%
Off Topic post were 18%

she also noted that the vast majority of positive post had a larger more diverse base than the negative post which were made mostly by the same twelve posters who all had a very high post count. The vast majority of negative posts that wasn't from those twelve came from the Xbox 360 general forums (understandable ) and were about disconnects and lag.

Now this and five dollars will buy you a small flavored coffee at starbucks, but I do find it interesting that from her count most of the negativity is coming from a small group of the same people and that most of the other complaints were from the Xbox forums.

I thought I had discovered something really revealing until another friend over at MMORPG.com said they had found similar numbers ages ago about most MMO's, the complainers are usually a small group with a "purpose" and they do a good job of making it appear like the forums are full of hate and angst.

I would have never guessed that, in a million years. I always thought that most folks on the forums just liked to complain.

Komakala
04-07-2013, 09:23 PM
It's very common, like you pointed out towards the end. There tends to be a smallish group that complain about most anything and everything, mostly because they enjoy complaining. Now there are a bunch of legitimate issues out there that are still in the process of being addressed, but if you spend enough time lurking around you'll start to see who is actually bringing valid concerns and who is just whining for the sake of whining.

Also keep in mind that this goes both ways, if you were to analyze the positive posts you'll find a fair number of them tend to come from a core group as well. And a lot of the clashes you see are between the forerunners from both groups. As with all games, you like it or you don't. Doesn't mean one group is right and the other is wrong, it's just personal preference.

cfStatic
04-07-2013, 09:34 PM
Vocal minority vs silent majority and all that. Still, it's nice to see that a good percentage(44 even!) were positive. I wasn't quite expecting that.

Xaearth
04-07-2013, 09:37 PM
I thought I had discovered something really revealing until another friend over at MMORPG.com said they had found similar numbers ages ago about most MMO's, the complainers are usually a small group with a "purpose" and they do a good job of making it appear like the forums are full of hate and angst.

I would have never guessed that, in a million years. I always thought that most folks on the forums just liked to complain.

I just have to disagree with this, as not all MMOs are alike.

Yes, there are patterns of small groups of people making waves in every MMO, but... well I was one of the negative posters not too long ago when SWTOR launched.

There were serious, legitimate issues that the devs and community reps in SWTOR refused to address with anything other than the occasional outright lie. I tend to believe that was more to do with the evil that is EA than anything else, but I must caution against ignoring negative posts, as those poor souls at EA Bioware might very well have told themselves "Oh it's just that small group of negative folks that crops up in every MMO."

Sincerely,
~ Teams of heal-locking Operatives

Arsenic_Touch
04-07-2013, 09:43 PM
I just have to disagree with this, as not all MMOs are alike.

Yes, there are patterns of small groups of people making waves in every MMO, but... well I was one of the negative posters not too long ago when SWTOR launched.

There were serious, legitimate issues that the devs and community reps in SWTOR refused to address with anything other than the occasional outright lie. I tend to believe that was more to do with the evil that is EA than anything else, but I must caution against ignoring negative posts, as those poor souls at EA Bioware might very well have told themselves "Oh it's just that small group of negative folks that crops up in every MMO."

Sincerely,
~ Teams of heal-locking Operatives

Mass Effect 3 comes to mind. Haha. We were just a vocal minority, that's why they released the extended cut. They didn't change much, but they know they screwed up and tried to fix it without wasting too much time. Which is why I think the last DLC citadel was such a fan service. It did soothe the angry folks. Still pissed off about the lies and that ending though....

cfStatic
04-07-2013, 09:49 PM
I just have to disagree with this, as not all MMOs are alike.

Yes, there are patterns of small groups of people making waves in every MMO, but... well I was one of the negative posters not too long ago when SWTOR launched.

There were serious, legitimate issues that the devs and community reps in SWTOR refused to address with anything other than the occasional outright lie. I tend to believe that was more to do with the evil that is EA than anything else, but I must caution against ignoring negative posts, as those poor souls at EA Bioware might very well have told themselves "Oh it's just that small group of negative folks that crops up in every MMO."

Sincerely,
~ Teams of heal-locking Operatives

The thing that killed it was that they weren't aggressive enough about fixing bugs as they should have been. Many instances were still bugged long after release(HK-47 for example). Maybe it was just me after having played Rift, but I was surprised how they didn't go after issues like that, things that seriously hindered peoples enjoyment of the game.

You're right though, you shouldn't outright dismiss the negative people, as they provide feedback in their own way - Devs don't ignore them because what they're complaining about just highlights certain aspects of the game that can be anything from mild annoyance to something that's out of balance or a game breaking bug. That being said, the people that are intentionally negative just to smear the name of an otherwise good game just because they can ought to be squashed underfoot.

ChrisJSY
04-07-2013, 10:11 PM
Exactly how were these metrics done? I assume it was manual, which meant checking every thread and poster for content and not purely of word based results as that'd skew any automatic system.

I hate extrapolation.

Elandriel
04-08-2013, 01:21 AM
So, I asked a good friend today who isn't a gamer but who is a specialist in analytics and metrics to do a survey of the forums and to find if the forums were in fact full of negativity or if it was more balanced than folks realized.

This is what she came up with. keep in mind this isn't a scientific poll and should not be taken as the last word, you may or may not agree with it depending what side of the fence you are on, but I thought it would spark an interesting debate.

She looked at General discussion Game play discussion and the sub forums of General PC General Xbox and General PS3.

The amount of positive post were 44%
The amount of negative post were 38%
Off Topic post were 18%

she also noted that the vast majority of positive post had a larger more diverse base than the negative post which were made mostly by the same twelve posters who all had a very high post count. The vast majority of negative posts that wasn't from those twelve came from the Xbox 360 general forums (understandable ) and were about disconnects and lag.

Now this and five dollars will buy you a small flavored coffee at starbucks, but I do find it interesting that from her count most of the negativity is coming from a small group of the same people and that most of the other complaints were from the Xbox forums.

I thought I had discovered something really revealing until another friend over at MMORPG.com said they had found similar numbers ages ago about most MMO's, the complainers are usually a small group with a "purpose" and they do a good job of making it appear like the forums are full of hate and angst.

I would have never guessed that, in a million years. I always thought that most folks on the forums just liked to complain.

If this friend of yours is a real specialist, she must have warned you that you are fabricating truth by this kind of limitation of possibilities.
What is positive and what is negative?
How were all those posts that say something good and something bad counted as?
Who was the deciding factor if a post is bad or good?
Were you counting threads or posts?

And many more other questions that would need to be answered before this metric can be taken seriously.
Good effort, from both of you to try and do it. If it would be done properly, if could be a god tool for certain things, but as it is, it's an insult to you and your friend that helped you do it.