Researchers Snag 60 TB of Everquest 2 Behavioral Data 66
A group of researchers who went from game developer to game developer looking to acquire data for studying online social interaction got more than they bargained for. Sony Online Entertainment keeps extensive server logs of everything that happens within Everquest 2. When the researchers asked if there was anything they could look at, SOE was happy to share the entire EQ2 database — upwards of 60 TB — for their perusal. In addition to basic gender and age queries — who interacted with whom, and when — the scientists are also trying to find ways to track more subjective characteristics, such as performance, trust, and expertise. "To get estimates of them, the team is experimenting with trying to track physical proximity and direct interactions, such as when characters share experience from an in-game victory. To give a concrete example of the data's utility, Srivastava described how he could explore the phenomenon of customer churn, something that's significant for any sort of subscription-based service, like cell phones or cable TV. With the full dataset, the team can now track how individual customers dropping out of the game influenced others who they typically played or interacted with. Using this data, the spreading rate and influence factor could then be calculated, providing hard measures to work with."
Update: 2/18 at 21:04 by SS: Sony contacted us to set the record straight about the shared information. All information that could identify players was removed from the data given to the researchers. Chat logs were not shared at all. Read on for SOE's full statement.
"The information Sony Online Entertainment provided for the research project was scrubbed of all PII (Personally Identifiable Information) prior to being provided to the researchers. For example, no content of any player chat logs were shared with the researchers. The information shared consisted of data such as which in-game characters chatted with each other and the volume and frequency of the contacts. None of this information was connected to, or linked with, the real names or other PII, of any players. Basically, the researchers looked at the connections between players and how their online networks were built and used, not the content of any actual conversations that these players may have had with one another (that content was not made available to the researchers). Additionally, some EQ2 players voluntarily participated in a blind survey concerning their playing habits and demographic backgrounds. This information was anonymously gathered and shared between SOE and the researchers. Finally, corporations such as SOE and the researchers' universities have controls and safeguards in place to help to protect the privacy of individuals who voluntarily participate in surveys for research projects such as this one."
Update: 2/18 at 21:04 by SS: Sony contacted us to set the record straight about the shared information. All information that could identify players was removed from the data given to the researchers. Chat logs were not shared at all. Read on for SOE's full statement.
Back in my day... (Score:2, Insightful)
Now, get off my porch.
Back in my day... (Score:4, Funny)
Re:Back in my day... (Score:5, Funny)
Re: (Score:1)
Re: (Score:1)
Second research finding! (Score:5, Insightful)
The Female elves aren't what they appear to be. LOL
Don't meet offline, trust me on this!
Re:Second research finding! (Score:5, Funny)
Re: (Score:2)
The female [...] aren't what they appear to be. Don't meet offline
Especially if their boob size matches the one in the game :(
Body Mass Index?!? (Score:2, Insightful)
FTFA: Mostly, the gamers seemed healthy; their body mass index was better than the US average and, although they were slightly more depressed than average, they were also less anxious.
How on earth is Sony measuring their customer's body mass index? I know 60 TB is a lot of data, but I don't believe that even the most magical of algorithms can derive player body mass indexes or whether they're "slightly more depressed than average" from it. I call bullshit.
Re: (Score:1)
But seriously, I'm certain that they just look up the player's real name in some sort of other data base(medical).
Actually, that would worry me more (Score:5, Interesting)
Actually, it was probably a survey, but you do raise a valid issue there about privacy. Exactly how much data did Sony share?
We were outraged that AOL shared some improperly anonymized search strings, which in some cases could lead to the guy's real identity. Here, if they even knew who to survey, it means that Sony just handed over RL names on a silver platter.
What else? Chat logs? 60 TB is a hell of a lot of data. And probably a lot of things you said at one point, but didn't think them too carefully, and probably didn't mean them in the long run.
As an easy example, think of all the people who've bought gold, or played a flirty female when they're male, or flirted with one who turns out to be male. Lots of public embarrassment potential. Or what if you talked about sex to someone who, as it turns out, was 8 years old? I'm sure some people would love to jump to conclusions there.
Sent some tells about sometimes wanting to kill your classmates or co-workers? I'm sure those will be worth some hysteria when the next school shooting comes around. Talked about drugs or about homosexuality? I'm sure some future potential employers would make a fuss about that. Confessed playing or chatting from work 'cause you're the network admin and the logs don't apply to you? Well, now Sony's logs do. Etc.
And how much of the billing data is in there, anyway? Enough for someone to steal your identity? But even if it was just enough to contact those people IRL and survey them, I'm guessing at least the email address must have been in there. I'm sure some spammers and phishers would love to have it too.
Basically even if you trust that those researchers probably won't do that, the circle of people with access to someone's private data just grew. It only takes one irresponsible git or disgruntled admin, or even an insecure network which someone can break into and look around, for that circle to grow even further. How many steps until someone does do something unethical with it?
Sony already did their part in not giving a flying fuck about protecting their customers' privacy, after all. It only takes one or two more people with the exact same cavalier attitude, before it bites some people in the arse for just trusting Sony.
Knowledge is power... Power is money... (Score:1, Insightful)
You both make good points about the privacy issues. Games like this are wide open to be data mined. But then the whole Internet is effectively an extension of this datamining. The whole Internet is becoming like a giant storage system to the data miners.
Its like the old say, knowledge is power. Unfortunately some people fail to realize everything they do online giving someone else small fragments of power over them (and the small fragments add up) because that is the way the companies want it. They want to
Re:Actually, that would worry me more (Score:4, Insightful)
Sony already did their part in not giving a flying fuck about protecting their customers' privacy
Why did you think you have any reasonable claim to privacy in an MMO? If you "sent some tells about sometimes wanting to kill your classmates or co-workers" not only would I not expect you to retain your privacy and anonymity, but I would expect Sony -- and anyone who read your tells -- to feel an obligation to notify the law. Talk "about sex to someone who, as it turns out, is 8 years old"? You should spend a night in jail just to cure you of your stupidity. Don't they teach you in school specifically *not* to make any assumptions about the age and gender of someone you "meet" online? You're worried that because you "Talked about drugs or homosexuality" potential employers might not hire you; if I were you I'd be concerned they wouldn't hire me because I lack any discretion and the common sense God gave a dog.
Do not write anything in any online forum anyplace, even under a pseudonym, that you would not be comfortable having viewed by your teacher/boss/wife/husband/neighbor. Period. You do not have any right to privacy online (somehow this slipped past the Founding Fathers) and you are a fool if you expect any.
Yes, be afraid! Be afraid! (Score:2, Insightful)
> Why did you think you have any reasonable claim to privacy in an MMO?
While I admit that not all speech is protected and some of your examples might have a bit of validity, your sense of proportions is way out of line.
> If you "sent some tells about sometimes wanting to kill your classmates or
> co-workers" not only would I not expect you to retain your privacy and anonymity,
> but I would expect Sony -- and anyone who read your tells -- to feel an obligation
> to notify the law.
Sony, maybe. Fr
Chilling effect? (Score:3, Insightful)
1. I hope you realize that exactly that was what allowed the Soviet Union to keep its citizens in check.
Yes, everyone knows about Stalin's brutal repression, but that was toned down a lot after Stalin. They discovered that you can control people easier by making them think you have a dossier on them, and they can eventually get bitten in the arse by something they said in the past. And that even something which doesn't outright warrant a one-way trip to Siberia can bite them in the arse in some other way. L
Re: (Score:3, Insightful)
Stalin... Sakharov...
Y'know, the real crime at the root of the online privacy debate has nothing to do with privacy, and everything to do with pretentiousness.
We're not talking about Sakharovs, people with dangerous ideas who genuinely have something to say, we're talking about people disguised as Dark Elves "cheating" on their wives through chat channels in a video game, or -- dorkier still -- IT admins who believe anyone outside their small circle of friends around the cafeteria lunch table give two shits
Really? (Score:2)
Really? It seems to me that among other things you were already dismissing as "lacking the common sense God gave to a dog" were even discussing drugs or homosexuality.
Make up your mind. Either we're talking about Dark Elves cybering and other uninteresting stuff, or about topics which affect legislation and taxes.
E.g., it seems to me like debating homosexuality is how those guys got any rights in the first place. Otherwise we'd still be at the stage where it's a capital offense.
E.g., discussing drugs seems
Re: (Score:2)
Re: (Score:1)
Does anyone know what Sony's policy is or are we all speculating. If it says they can share this data, then you click "I agree" and play, then shut up about privacy.
I know Sony has some draconian hiring policies, they put you through a wringer to find out if you are a good worker bee. You have to pass a "personality test" made up of vague questions with "yes or no" answers. Things like "Daydreaming is good, yes or no?" Depends. Operating heavy machinery, I'd have to go with bad. Relaxing in your backyard on
Re: (Score:2)
My first thought about the story was: "Ugh, privacy!" so I agree with you, but this:
> As an easy example, think of all the people who've bought gold [...] Lots of public embarrassment potential. ..made me smile.
Re: (Score:2, Informative)
...I don't believe that even the most magical of algorithms can derive player body mass indexes or whether they're "slightly more depressed than average" from it. I call bullshit.
TFA also states that the user data "was followed up with demographic surveys of the users." I'd wager that among the demographic information collected was height and weight, as well as some mental health type questions. Admittedly, those aren't questions I'd expect if someone was surveying me, but I'd probably ask them if I were surveying a group of Everquest players...
In other News... (Score:1)
Re: (Score:2)
what a waste of space (Score:2)
what a waste of space.
"social" data?
from a MMO?
my god man....I can find thousands of better reasons to use 60TBs of space and not have to use the best one of "for p0rn."
shoot...mapping the world...mapping the oceans, mountains, space, al gore's head, folding, seti, another wayback project, etc.
Re: (Score:3, Insightful)
Not really, if running an MMO is what your company does. Keeping such logs is key to analysing game balance, tweaking the environment to optimise fun and game challenge, banning exploiters, and in general understanding the weak and strong points of your game, and fixing the weak ones. If you think those decisions are made solely on the basis of whiny posts on the forum, you have another think coming.
The interesting part is that this data is now being analysed in a different way,
I can see that, but... (Score:1, Troll)
I can see how Sony was happy, but I can't see how raping people's privacy for a buck is ethical in any form or shape. And in some parts of the world, it's probably even illegal.
Because make no mistake, it was for money. Simply put, "Let's see if these people can figure out how we can make more money in subscriptions." Apparently the prospect of a quick buck is all it takes for a corporation to sell your data.
From the biblical 30 silvers, t
Re: (Score:2)
Judas didn't have shareholders (Score:1)
> Apparently the prospect of a quick buck is all it takes for a corporation to sell your data.
The irony is that Sony is legally required to do that if it seems that that would increase its profits. The only thing which would justifiably prevent it would be a reasonable fear of bad publicity causing a decrease of revenue, instead. Hmm, how many Slashdotters play Sony MMOs? And exactly how many fewer will play Sony's games because of this?
Re: (Score:3, Interesting)
Maybe if they hadn't nerfed Necromancers (et.al) in EQ1 they would still have a bunch of those customers. The game became a overwhelming exercise in extreme frustration in which many a Necro silently wished extremely bad things on the entire staff of Sony, those nerf'ing motherfuckers. Looks like those wishes came true.
I guess making lifetap a resistible spell wasn't such a great idea afterall, was it bitches?
Re: (Score:2)
Bitter!
Party of one...
Shareholders wishes, eh? (Score:1)
> Sony is legally required to follow it's shareholders wishes
And barring a shareholders' meeting actually deciding something to the contrary, IMO most courts would assume that those wishes are to earn as much money as possible, without doing anything illegal or morally repugnant. Meaning, morally repugnant to Joe Sixpack, not to your average Slashdotter. Or do you have some kind of precedent you could post as evidence to the contrary?
Re:I can see that, but... (Score:5, Interesting)
Re: (Score:1)
I can see how Sony was happy, but I can't see how raping people's privacy for a buck is ethical in any form or shape. And in some parts of the world, it's probably even illegal.
That all depends on if they allowed the researchers to may in-game data to real world data.
How is your privacy effected if the researchers find out that "WillowCakes341" had a middle-of-the-woods encounter with "BendyStraw_Jack"?
LK
That's actually the whole problem (Score:2)
I understand your point, and it's a very valid one, but:
1. Supposedly, they also found such stuff as what the average gamer age is, that they're slightly depressive, or what their BMI is.
It doesn't exactly sound like that's strictly about the characters, sorry. (I'd think that all those dwarves and barbarians would have a higher BMI than these guys found;) As I was saying in another post, even if they then surveyed those people, the fact remains that they knew who and where to contact. I.e., at the very lea
Yikes (Score:3, Interesting)
In particular, if the researchers have access to user/character names (or worse, real ones!), Sony could be in violation of the Children's Online Privacy Protection Act. I'm not a lawyer, but:
(F) any other identifier that the Commission determines permits the physical or online contacting of a specific individual;
Particularly if names can be correlated to age, it seems unwise. Without assurance that personally identifying information is not in the data, any parent of an EQ player should be concerned that they were sent to "a collaborative group of academic researchers at a number of institutions".
Re: (Score:2)
COPA does not apply. From the EQ2 EULA:
Re: (Score:2)
COPA does not apply.
Well, you're right about that. I goofed up; COPA is dead. COPPA, on the other hand, might well apply.
I'm still not a lawyer, but since Sony's privacy statement claims they comply with COPPA, I'd suggest that the parent's agreement to the terms of use does not waive the child's rights under COPPA. Further, even if that wasn't the case, I'd think there'd need to be a specific provision detailing to whom the data can be disclosed. Nowhere does Sony make folks agree to share children's data with academic rese
sweet (Score:1)
Re: (Score:2)
And if you're not so awesome, you pay for the game, and also for the popular guys subscription as well. Awesome lol.
The only one getting better from this is the guy owning the big server (and possibly the researchers who might sell this investigation for quite a bit of money, if they ever figure it out).
I'd be more worried about such massive amounts of data being shared for commercial purposes. Hopefully still anonymous, but the word "privacy" or "anonymous" isn't even mentioned in the article.
Re: (Score:2)
The biggest dropout spike (Score:2)
Would be the month WoW came out. I lost most of my EQ2 buddies to WoW.
Re: (Score:1)
Re: (Score:2)
What trade nerf are you referring to? I actually just started the EQ2 trial, so I'm curious, not defensive.
I forgive Blizzard alot because they NEVER beat me down like EQ-EQ2 did.
I played WoW for several months, but ultimately couldn't get over how simple it was. I played EQ1 prior to WoW, and I now wonder if WoW needed the nerf bat less, because it was a lot more bland to start with so that imbalances that needed 'correction' don't crop up nearly as often.
Re: (Score:2)
I was on the beta, though I didn't remember them being so close together.
I'm not returning to SOE (Score:1)
Re: (Score:2)
What? It says that in the first fucking paragraph!
"With the cooperation of Sony, a collaborative group of academic researchers at a number of institutions have obtained the complete server logs from the company's Everquest 2 MMORPG."
And how about quotes like the below, which make it crystal clear that they were able to actually read the chat interaction
Buried among those happy, average players was a small subset of the populationâ"about five percentâ"who used the game for serious role playing and, according to Williams, "They are psychologically much worse off than the regular players." They belong to marginalized groups, like ethnic and religious minorities and non-heterosexuals, and tended to use the game as a coping mechanism.
The only way they'd know they were role playing is to see the chat.
I don't know in what world you live in where "complete" means "just anonymous usage statistics", but this is Earth.
Re: (Score:1, Informative)
It was all anonymized data. The role play insights came from interviews.
Re: (Score:1)
Re: (Score:1)
Oh and again look up to the post "You dont own your words" and there you will find why SOE will not be getting a lawsuit.