Interview: WowLens and a National Science Foundation grant help researchers mine player data

Researchers at the University of Minnesota, Carnegie Mellon University and the University of Pittsburgh, under a project by the National Science Foundation, are using an addon called WowLens to gather peer review data. The project aims to use the wealth of people, resources and data floating around Azeroth in compiling data for research projects. It personally reminds me of Folding@home, but with statistics instead of computer processor cycles for medical calculations.
I got to have some questions answered about the project by Professor John Riedl of the University of Minnesota Computer Science department and Daniel Moy, one of his colleagues and students. If you would like to get involved with the project, simply head over to the WowLens site and download the client. You run the program before opening World of Warcraft, answer a few survey questions, and at the completion of a group, you answer a set of questions pertaining to your experience with the players in that group. Let's let the researchers themselves tell you about their project.

Professor John Riedl: My group is GroupLens Research at the University of Minnesota. You can read our Wikipedia page here. We wrote much of the page, but it's the most complete telling of the story.
In the past seven or so years, we've been working with our colleagues from the social sciences at the University of Michigan, Carnegie Mellon University and the University of Pittsburgh, to apply insights from how groups of people work together to improve online collaborations. For the past three years, we've been using World of Warcraft as one of our study platforms. We're particularly interested in developing new intelligent user interface technologies that can make teams in WoW work together more effectively.
The current plug-in is one of those pieces of research. We're exploring how what is known about group formation from the social psychology literature can be applied to help make WoW groups happier and more effective at their goals.
Daniel Moy: The overarching research we're working on is a National Science Foundation grant between three universities (Carnegie Mellon University, University of Minnesota, University of Pittsburgh), looking at online groups. This covers groups in a variety of different settings, including both Wikipedia and World of Warcraft. Specifically for World of Warcraft, we're looking at figuring out how to understand and improve group satisfaction, cohesion and coordination. Finally, WowLens itself is looking at whether or not we can use an in-game rating system (of peer ratings, not arena ratings!) to help players form better groups and in general have more successful, happy game experiences.
AS: What interested you guys about Wow? Was it the size of the player base? Are members on the team players?
Moy: Yes, the large player base size is a definite attraction. If millions of people use a system, chances are there could be interesting research questions to answer. There's also quite a bit of existing academic research into various aspects of World of Warcraft. As for the second part of the question, most of the group has played WoW at one point in time, including one of the professors. Only two of our current group members are ACTIVE players, though a couple more keep up with the important news, trends, etc.

AS: What were the contributing factors to choosing WoW as the testing ground?
Professor Riedl: We're particularly intrigued by WoW because of the team aspects of the game. We like the way small "work groups" (parties) and larger "organizations" (guilds) interact over time. One of the challenges for WoW is how these small groups have to form over a short period of time, and then fade away, replaced by other small groups. These sorts of dynamic reformings are unusual in physical world groups, but seem much more common in online communities. What tools will best support this new community behavior? How can it be made more fun and effective?
Several of us are players. Daniel has a long history with the game. Tony (the lead grad student here at Minnesota), Bo (the lead grad student at Carnegie Mellon University) and I have also played, though not to the expert level. Kristina (the lead grad student from Pitt) and Vanessa (a M.S. student from Minnesota) have played to end game. On a personal note, my son Kevin has played to the expert level, and I've enjoyed talking about the game with him.
We are very impressed with the game as an enormous-scale online community. The level of interaction among players is fun and interesting, and the scope of the world is breath-taking.
Moy: MMOs are useful in their own right for a many reasons. Some of these include complex or obscure task solving, spontaneous group forming and the insane amount of time users tend to play. World of Warcraft specifically does have a alluring amount of research data, with orders of magnitude more players than other MMOs.
AS: Who developed the addon for you guys?
Moy: I did, in its entirety. I played as Pharaunmizz on Greymane and had a bit of an addon affection complex already going when we started. When we were looking for ways to get research done, we tossed around the idea of using an addon. I had to learn Lua and the WoW API to actually implement it all, which was a long and painful process. Big, big thanks to wowwiki, wowprogramming and #wowuidev.
Professor Riedl: We're impressed with the Lua environment for extending the WoW interface and would love to build further add-ons to make players' WoW interactions more positive. We'd love to hear any ideas you have for addons that guilds would appreciate!
AS: What can readers do to help contribute to the work you do?
Professor Riedl: The most important is to use the addon! We're very excited to get user feedback and learn how to make the addon more valuable.
We'd particularly love the opportunity to work closely with some of the large guilds to build tools with and for them that would help their interactions. Please encourage your readers to contact us at wowlens@cs.umn.edu. The great thing is that we have research support to build cool tools for WoW players. Let us know what the community would value, and we'll figure out if there are interesting research questions to explore!
Moy: The first is to use our addon, WowLens, and religiously submit data. We've built a clean little addon that runs in-game like any other addon, and a data uploader that will upload data to our servers, download an updated data set for you, sync everything up and automatically start World of Warcraft. This uploader is meant to be run instead of the usual WoW shortcut to start the game; it should handle starting the game itself cleanly for the user.
AS: What other uses do you think addons can haev in research besides data collection? Any other impacts on the research world?
Moy: A good question! Passive data collection, while useful, isn't as fun and can't answer a lot of the interesting research questions. The potential for using addons in active research experiments is very, very appealing. Also, simply having a user base with an addon linked to a research community, perhaps on an outside website, could be invaluable, especially if it gains any popularity with the player base. Again, if anyone has any thoughts about future directions, we're always willing to listen and explore new ideas.
Professor Riedl: Over the long-term we'd like to create tools that make peoples' social lives richer and more fulfilling. We are enthusiastic about WoW as an online community with a powerful social component, and would love to explore how research can make it even more satisfying.
Once again, thank you to Professor Riedl and Daniel Moy for taking the time to answer my questions. If you'd like to help out with the Wowlens project, check out their website and provide some feedback!
Filed under: Add-Ons, Interviews






Reader Comments (Page 1 of 2)
Minos May 11th 2010 11:16AM
This is a cool project, but they should reconsider how they're distributing the addon. From their download page:
The easiest way to use WowLens is by downloading and running our Installer. This will install the addon into the correct folder, install the uploader, and create a shortcut to your desktop that you should use to run Wow. This bypasses you having to unzip an addon and put it in your interface/addon directory.
Addons packaged as an executable installer are common vectors for trojans and keyloggers. I would recommend getting the separate addon and uploader from their Other Downloads page.
Grovinofdarkhour May 11th 2010 12:51PM
I wonder if they're associated with the Society for the Helpful Intrusion of Technology and Totalitarianism for Industry, Nation and Globe.
I wonder if there's an anagram in there somewhere.
Turtell May 11th 2010 11:18AM
Ulterior motives
Meatwadz May 11th 2010 2:23PM
Maybe the true ulterior motive here is to create a sense of accountability in the game. Imagine how people may alter their behavior knowing that their rudeness and greed now have consequences that will significantly alter their group gameplay experience. People will actually be rewarded for good behavior! The success of this addon could mean a more true-to-life society where your reputation really does stick with you.
James May 11th 2010 11:22AM
I am still always baffled by how wow is like the promised land of social and mental reasearching. Blizz must hire therapists to design the game. Ghostcrawler promised me a psychiatric evaluation. Should be any time now -- we got the pony.
Alanid May 11th 2010 11:45AM
Woah woah.... read therapists as the rapists. False alarm.
Grovinofdarkhour May 11th 2010 11:59AM
My confusion was on the word "must."
So, did you read it like "it must be the case that what Blizz does is hire the rapists to design the game", or "it is imperative that Blizz hires the rapists to design the game"?
Blacksheep May 11th 2010 12:23PM
Blizzard has a team analysts working on this and you say they have therapists also? My word, I think they have a team of twice over professionals here, some kind of new combination, the world's first analrapists!
Cataca May 11th 2010 12:46PM
To be a good MMO producer you must be part mathematician, programmer, analyst, psychologist, philosopher, sociologist, artist, and writer.
Kemikalkadet May 11th 2010 1:05PM
Thanks, Alanid. I'll forever read therapists as 'The rapists' now.
nerdrage May 11th 2010 1:19PM
snl lol
' i would the rapists for 400'
tatsumasa May 11th 2010 11:23AM
a screenshot of the addon in use would be swell since you don't even say what it basically does. i went over to the site and saw that the addon lets you rate people you group with in four ways (friendliness etc.) and lets other with the addon see this information.
the questions i have are more about the installation process than the addon itself. why create a self-installer when 99% of the people who would use this addon already know how to install them? yes, i made that number up, but seriously... and more importantly, why does this addon create a new launch icon to start wow? that's very strange. i went to their faq section but it seems to be experiencing a fatal error atm.
Jiyambi May 11th 2010 1:46PM
I believe it was implied in the article that the special launcher is there so that the addon can sync it's data every time you start WoW. This ensures regular updating of the gathered data to the server. I think >_
tatsumasa May 11th 2010 3:35PM
okay i must have missed that somewhere. if that is the case, that's a pretty lame way to go about it. they should decompile gearscore then which syncs with whoever you tell it to, or recount which syncs with everyone in your group unless you tell it not to.
good concept; needs some work on implementation.
SirWilliam92 May 11th 2010 7:02PM
It isn't about syncing it with other players. The launcher syncing they are talking about is getting the data back to their servers so that they can actually do the analysis of it. The process needs to be outside of the actual game because add-ons can't send data to random servers during gameplay (imagine the potential drama in that).
Burnaphatone May 11th 2010 11:49AM
I am going to get this addon and rate everyone I pug with as low as effing possible. I love being an outlier in statistics, I learned it from Calvin when he filled out a survey for Chewing magazine where he stated he was a 40 year old who spends $300 a week on gum and his favorite flavor of is garlic/curry. Messing with data is fun. Downvote me for this please.
JC_Icefox May 11th 2010 12:29PM
Being an outlier in statistics doesn't make you a rebel, it makes you an anomaly. Good scientific data will streamline the data collection process for averages and patterns.
In all liklihood, your data will be called an error and left unused or possibly thrown out.
Mullen May 11th 2010 11:57AM
Someone needs to talk to these people about how they present themselves to the WoW community. They have little, if information on the website, with a few parts of the website not configured from the default installation. Plus, we have all heard, "Just download this binary and everything will be good" many of times, but that is why we have authenticator tokens. Plus. they don't have a Mac client, which is really annoying.
scaresome May 11th 2010 12:01PM
An interesting project and I fully encourage it.
I won't participate because the process already feels bulky and intrusive to my game play. If there was a small addon via Curse that tracked my experiences, that'd be okay with me but a new launch screen makes me nervous and I feel like I am working for The Man.
Like said above, its astonishing how many colleges look to WoW for research information. This is still an artificial world; how discouraging it would be to find perfectly sane people who spend hours ganking a level five hunter or spend a mind-numbing three hours "fishing" for a turtle?
Finally, the idea of glomming on the small group process in a game can't form meaningful numbers. I'd say look to other temporary situations that are just as short-lived like doing a piece of theater or a pick up basketball game.
Good luck researchers!
Cataca May 11th 2010 12:54PM
What would be if they could see the impact of the user base -not- using the addon.
Is the reason why the average player -doesn't- use their addon just because the average user doesn't know about it, doesn't care, or because they are wearing a tin foil hat and are weary about the .exe installer and the intrusive nature of sending private data.
Does the majority of the player base wear tin foil hats? I'd say yes...it's either tin foil or pants on head around here.