Are We All Just Beta Testers?
by Elizabeth Harper 
Apr 25th 2006 at 9:00AM
GameDaily has an interesting article up about how game
developers seem to be using players as beta
testers. Buggy code is released as a final product to the public with the thought that it can always be fixed
with a later patch. And, while the article specifically discusses single player games, the argument is perhaps
even more applicable to large MMO's in which regular patches to add content (and fix old bugs) are the norm.
While it's understandable to an extent - World of Warcraft is a massive game, and it would be impossible to test every
race, class, and talent spec in every situation - some of the bugs are sufficiently obvious that they make one wonder
how much testing happens at all. However, perhaps MMO's are so expansive that it's imposible to give them the
full quality assurance treatment in the traditional sense - which is why we've ended up with test servers and a regular
patch cycle. What do you think - are we beta testing the software we're paying for? And should we be?
Reader Comments (Page 1 of 1)
Carl Smith Apr 25th 2006 9:10AM
Although it is annoying, the bugs in WoW seem reasonable. The patch thing does give developers a saftey net to rush product, but it is in no way as bad as many single player games. The worst of the "Beta" games are for home platforms, like Madden Football for PSP. That game was nearly nonfunctional in every way when it hit shelves. And most home games do not get the priveledge of patching. Good discussion, but I think WoW is as good as we can expect in every way (for servicing over 4 million customers too!)
joey Apr 25th 2006 9:46AM
If you want to play a MMORPG type game in any sort of timely manner, the bugs are just a reality. They are simply too complex and large and have too many interactions to test completely before release. The number of beta testers required to test all of those interactions are why these types of games sumbit themselves to open betas.
I'd rather play wow today with some bugs. Than wait 10 more years for the bugless version myself.
boneyard Apr 25th 2006 10:24AM
there will always be bugs, nothing to do about that. but i do feel that mmorpg companies are easier with just letting some bugs slip through with the idea that they will fix it in the future instead of now.
just look at the test servers, often enough bugs aren't fixed even when they are known. not that bad ones of course, but enough go live.
Dawn Cafaro Apr 25th 2006 10:59AM
As a developer of far more simple software I understand the challenges of creating bug free code, I couldn't imagine trying to do it on the level of code as complex as WOW must be.
Not to mention, every piece of code I write works perfect for me, it's users doing things that I could never anticipate that mess with my code, Imagine having as many users as WOW has, and some of those users go out of their way to create problems, bugs are an accepted part of the gamming experience for me.
Mat Apr 25th 2006 12:10PM
It's not so much that I mind the bugs or stability issues, but more that we're kept in the dark as to the progress in their resolution... If Blizzard simply communicated more I think I'd be ok with it, but instead we end up with:
-Server Restart in 15:00
-Sorry for the inconvience but we are restarting the server in 14:30. Thank you for your patience.
Then it boots you at 4:00 just when you're running to a safe place hehe :)
Keith Apr 25th 2006 12:48PM
ok... if you people think wow had a lot of bugs when it launched you have obviously never played any other mmorpg... wow is EASILY THEE most polished game to EVER hit the mmo world. let us all remember anarchy online and shudder... nuff said
Ysidro Apr 25th 2006 1:58PM
As someone who has done a lot of work in an enterprise IT deparment, I can tell you that big, complex systems can show issues.
The reason that WoW has continuing issues is not that the code is bad, its because they keep upgrading and improving the game. If they only made bug fixes, the game would get stable very quickly. But then the game play improvements wouldn't happen.
You simply cannot test for every variable. That's why there are issues, even after the test server seemed stable. With continual development and the community constantly pushing them for game play changes, its a miracle it runs as well as it does. The sheer size and complexity of their system is a wonder.
This kind of article we see above is one serious strawman and a bit pointless. We gamers get EXACTLY what we ask for. New games and content constantly. This means bugs. If they delayed, we would whine about that and cast asperations about the quality of their code for needing so much testing. The game creators just can't win. WE cause this problem by demanding new games and content all the time.
To suggest that we are collectively being used to improve code quality is silly. If quality is so bad, stop buying the games. But that won't happen now will it? We want more and faster. We created this monster, no use whining about it unless we are willing to change our collective buying habits.
Ysidro
Deser Apr 25th 2006 2:42PM
I could care less about the bugs and stuff like that. I know it is gonna happen. I know there isn't much more that blizzard can do with it.
My problem is the server stability, lag, and the like. I played EQ for years and FFXI for a year or so. I never had server instability like I have experienced in WoW. I would actually be happy if they left the content alone for a little while and focused on fixing whatever their server issue is. (I know that the two areas are handled by different areas within Blizzard but you can't fix what's broke if you have variables changing constantly.)
wuchi Apr 25th 2006 8:41PM
i dont recall beta sucking as badly as this.
didnt all the good MMORPG ppl from blizz go to arenanet and work on guild wars?
with all that said i have to confess
i would HATE to work in their IT department. i would rather run naked thru iron forge with my level 5 tauren priest.