Scattered Shots: Understanding the PTR process

The patch 4.0.6 PTR process has been a volatile one for us hunters. We went from gentle nerfs and buffs to OMG HORROR nerfs and WHEE BUFFAGE buffs, then had those scaled back a bit. And I have to tell you, I don't think the ride is over yet.
Any time Blizzard announces changes, there's always a very reactionary response, and I suppose that's just part of the game. But lately I've been getting more and more emails and comments from hunters complaining about how the PTR is run or clearly not understanding the purpose of the PTR.
Why does Blizzard release clearly buggy abilities? How can the designers not see that this is OP/useless now? Don't they even play the game? Well, I'm going to suggest that these are not problems with the PTR or the designers but instead a problem with expectations. Join me after the cut for some clarity on the PTR process and why hunters have had such a crazy ride recently.
WoW is a constantly changing game
The first thing we have to understand is that WoW is a constantly changing and evolving game. Unlike, say, chess or Carcassone, an MMO is an incredibly complex set of interacting mechanics. The comparative value of those mechanics, the game balance, changes based not just on everyone's abilities but also on the kind of content that's currently available.
You'll note that no MMO is ever "done" or somehow balanced perfectly, even within any given expansion. Each expansion in WoW lasts about two years, and for the entire duration of that time, tweaks and changes are continuously being made.
The thing to understand here is that if something in the game is not balanced ideally, Blizzard can just change it in the next patch or hotfix it. This is an important concept for how the PTR works, and we'll be coming back to it.
Of designers and coders
Another thing to keep in mind before we start talking about the PTR itself is that the designers, the guys who are responsible for class balance and new abilities and raids, are not the guys doing the actual programming. While they can easily go in and tweak some changes, other changes are very complex and require the programmers to go in and overhaul the code.
There's no telling which is which -- sometimes the simplest seeming changes are the most complicated to implement. And just because something works one way in one place doesn't mean that the current code supports the same functionality in another place. Code is complicated and fickle.
When changes are considered, the design team gets together to discuss them. There are about 10 or so designers handling all our class changes, and all of them pay attention to all of the classes. There is not a designer for each class -- a hunter designer, a warlock designer, etc. There are just a bunch of designers doing it all together, so they have a better understanding of the big picture, how the change to one class could have repercussions to other classes.
Certainly there might be one designer who plays a priest as his main, and the guys are going to give his analysis more weight since he might know that class a bit better, but they all are familiar with all the classes. So they discuss what they think needs to be done and generally make their decisions by consensus, rather than voting or the big GC stepping in and saying how it will be. When a change goes through, it's usually because the design team as a whole agreed that it was needed, or at least worth testing out.
Now that they've made those decisions, all those changes have to get passed along to be actually implemented in the next PTR build. So there's a delay between making the decision and when the decision actually goes out on the PTR. Oh, yeah, and someone has to write them up for the patch notes.
Decision and implementation delay
Another thing to understand is that Blizzard wants to get things on the PTR as quickly as possible. The longer it's up on the PTR, the more testing is going to get done and the more likely Blizzard is to discover some of those pesky, hard-to-pin down bugs.
If the designers decide to make, say, 361 changes in a patch, they might go ahead and put the PTR live when only 283 of those changes have been implemented. For hunters, we saw the slight SV agility nerf and some gentle MM and BM buffs when the PTR patch notes were first released. Then a couple of days later, we saw more SV nerfs and more BM and MM buffs. It's entirely possible that these were all decisions made from the get-go, but it just took a bit longer for some of them to get implemented.
Likewise, there's this mysterious haste code change that we keep hearing about. It made it into the patch notes but wasn't actually implemented on the server. The code guys are apparently still working on it.
Now this isn't to say that everything that happens on the PTR was planned from the beginning. After all, we saw the 25% Explosive Shot nerf and the Serpent Spread nerf reduced or reverted in a later update. That was clearly a reaction to the massive hunter outcry. Alas, we have no way to know which changes are in response to us, the players, which ones are in response to PTR data that Blizzard is seeing, and which ones were planned from the beginning.
Why don't they just wait until it's all done?
A fairly common complaint that I get is, "Why doesn't Blizzard just wait until all the changes are done and working before they put up the PTR?" This is where we get back to the very first concept we discussed: WoW is a living, constantly changing game.
If Blizzard waited until everything for a patch was complete and working ... then that would be the patch. Not the PTR. Since the game is constantly changing anyway, if it turned out that something was unbalanced or exploitable, it could then just fix it in the next patch or hotfix.
So the PTR, by design, exists in this "in progress" period before everything is done.
It's good for Blizzard because the designers get more eyes on the proposed changes and more bodies testing and finding bugs. And because the PTR exists during this "in progress" phase, it doesn't delay the patch from actually going live. It's good for us because we have a chance to voice our opinions before the changes go live in the game, and sometimes our feedback changes design decisions (sometimes for the better, sometimes for the worse).
What does this all mean?
Well, other than the fact that it's interesting to see how Blizzard works, I hope that this helps informs how to respond to PTR changes a bit.
Since Blizzard is only telling us the changes that are implemented on the PTR and don't tell us what is coming to the PTR a few days from now (and for good reason -- maybe the designers'll change their minds about those coming changes), we can only respond to the changes that we see.
However, because we know that what we're seeing isn't the whole picture, we can give feedback in a more reasoned way. If we think a change is bad, we can calmly explain why we think it's bad, rather than reverting to hyperbole and name-calling and threatening to quit playing because our class is unplayable if we're in the middle of the pack. Keep in mind that the nerf that we're seeing may well have been planned because of a buff that just hasn't been implemented yet.
It's easy to fixate on one thing that sucks -- Explosive Shot being nerfed -- and lose sight of the big picture. And of course, the big picture is that hunters are awesome and continually becoming awesomer.
Filed under: Hunter, (Hunter) Scattered Shots
Patch 5.3 interview with Ghostcrawler
Mystery of the Unborn Val'kyr
The latest patch 5.3 news
All of the latest Mists of Pandaria news





Reader Comments (Page 3 of 4)
Hraklea Jan 17th 2011 3:53PM
Only 10 designers? Seriously?! That's why WoW have these huge problems of design.
Zhiva Jan 17th 2011 12:26PM
I reported bugged Launcher on 4.0.1 PTR several times, after every new build. 4.0.1 was released with bugged Launcher.
Bapo Jan 17th 2011 1:43PM
Everybody has a self heal but us.
CHIMERA SHOT - Heals 5% of your total health
You also have pets that can heal you too
That is all.
Bapo Jan 17th 2011 1:43PM
Comment fail >.<
Clevins Jan 17th 2011 1:46PM
Mmm... I don't have an issue with the changing nature of the game or the nature of the PTR.
What makes me wonder are things like the 25% Explosive Shot nerf that a day later was 15%. I doubt they got all that much data in ~1 day. And, while I get the concept of turning a setting farther than you really intend to go so you gain understanding of the effect, it still surprises me that they don't have better simulations of the effects of things. But at the end of the day it's the whipsaw nature of the changes that give the appearance of some randomness combined with things like the Great BM nerf that make people react. Well, that and some people just have QQ in their hearts.
icepyro Jan 17th 2011 2:20PM
I wish this world was not black and white. Oh, wait....
What I mean is, what is this article telling us?
Is it telling us that we have no right to complain because this the PTR and not complete? No.
It is telling us that this is how the PTR works. There are bugs to be worked out. There is code to be implemented. It is for the public to TEST what they are thinking about implementing.
Should we complain? Well, define complain. Criticize? Surely. Explain what is wrong with this change because something is broken, bugged, or otherwise destroys balance? Okay.
Tell Blizzard that the sky is falling, that we suck in PvP, that we are switching classes because of the PTR, that there are many bugs they need to fix or else, that we are quitting this game? NO. Or rather... if you are threatening to quit, then please do so the rest of us can enjoy the game.
Does it sometimes seem Blizzard is ignoring a bug? Well, they do have to code the fix so maybe that just isn't finished. I like to think the Trap Launcher bug is a fine example of this. I have a dollar that says they knew all too well that it was bugged, but couldn't fix the code in a reasonable amount of time.
Do I feel they make bad changes? All the time. Do I feel a need to defend Blizzard for these? No. Do I feel the need to rant on a blog site about why Blizzard hates hunters? No.
So don't get things confused. Reporting bugs, explaining the upsets in balance and what Blizzard can do about them is one thing. QQ is entirely another. This article is to explain how PTR works to filter out some of the QQ. Maybe if we were not subject to such hyperbole that the world is forced to be black and white, then maybe we could move past this.
Then again, I do realize I may be exaggerating a small amount. Maybe not. I can't tell anymore.
Disgruntard Jan 17th 2011 3:48PM
Tell Blizzard that the sky is falling, that we suck in PvP, that we are switching classes because of the PTR, that there are many bugs they need to fix or else, that we are quitting this game? NO. Or rather... if you are threatening to quit, then please do so the rest of us can enjoy the game.
How does people presenting legitimate grievances about the problems in the game effect your enjoyment of the game? You can't have fun unless everyone kisses Blizzard's ***?
icepyro Jan 17th 2011 9:50PM
I see exactly how much of my comment you read. Thanks for quoting it. I do believe I answered your questions in all of the rest of the comment.
Incidentally, in case I wasn't clear, people presenting legitimate grievances about the problems in the game does not effect, nor even affect, my enjoyment of the game. Although, your comment did bring about much laughter and enjoyment. The absurdity of equating legitimate grievances with the paragraph you quoted is hilarious.
SamLowry Jan 17th 2011 11:09PM
I couldn't care less if the devs go absolutely loco on the PTR and change everything just to flex their creative muscles, but if crazy-stupid changes go live then we have a right to complain.
And we also have a right to complain when something that was supposedly tested by hundreds of players seems broken, unintuitive or just plain wrong. When I was leveling my worgen from 1 to 85 I should have kept track of the number of times I heard myself saying "Someone tested this?!?"
icepyro Jan 17th 2011 11:19PM
Agreed.
Brit Jan 17th 2011 2:46PM
CARCASSONNE!
Yay!
So apparently I'm not the only person out there who loves both WoW and great German board games... :D
SamLowry Jan 17th 2011 3:26PM
Shoulders? Interesting that you say that since the questgivers for the first set of plate shoulders in both Vash and Hyjal are either broken or missing. So now there's a guy hanging in a Hyjal cave for seemingly no reason--great job on that testing, Blizz.
classbalance Jan 17th 2011 4:44PM
This is a load of horse $%#@. When it comes to hunters, the question Blizzard must answer is, does this make hunters competitive and if it does, how can I nerf it without being obvious. If you have played hunters for as long as I have, you know that the minute a hunter ability is considered OP, blizzard doesn't even wait for the next patch. It gets "hot-fixed" right away. Which is far different to how blizzard treats abilities in other classes. Druids went through an entire expansion before they got nerfed. Blizzard even admitted they were aware that druids were OP, but "didn't feel implementing a fix in the middle of an expansion was the best course of action"(paraphrased). People complained that Death Knights and Paladins were OP during Wrath beta and after release of Wrath xpac, but they consistently denied there was a problem. They stated everything will balance out when people reach 80. After several months and it was obvious that things haven't balanced out, blizzard whips out the nerf bat.
In terms of Hunters, PTR is just to allow Blizzard to make sure hunters continue to stay sub-par. That is why, unlike most other classes, tweaking hunter abilities is such a coaster ride.
Shrike Jan 17th 2011 6:29PM
Oh, NOES! If you actually tell them you realize it, they might validate your persecution complex!
Anzor Jan 17th 2011 4:53PM
Two more things to consider.
1. Sometimes programmers purposely break things. They get a bug report but can't track down the exact cause so they start trying to force the error to occur again.
2. It is easier to test things in extreme. If you see a general trend indicating something is unbalanced, if you exacerbate the issue you can see more clearly what is actually occurring. If you imagine a graph, the difference between the highest point and lowest point is more greater than any other two points in between.
Anzor Jan 17th 2011 4:54PM
*greater, not more greater. Grammar fail =(
Jidan Jan 17th 2011 6:02PM
@Disgruntard
Your behavior in this comments section pretty well defines what Icepyro and the author are talking about. One can have greivances. One can have complaints. One does not have to rant, rage, call names, or otherwise QQ about it. One can critique thier class's ability to pvp, but one does not have to resort to whining.
Besides that, I thought both Icepryo's comment and the article were well written, and ring true.
Disgruntard Jan 17th 2011 6:20PM
Presenting reasons why I think the hunter class is broken does not constitute "ranting and raving," but accusing people of "whining" and "qq" when they express opinions that differ from yours is flat-out trolling. You have a lot of nerve criticizing anyone for their "behavior" when you're clearly looking to attack people, rather than rationally discuss the issues I raised.
I am also concerned about the way many bloggers play up the hunter class, not being honest about its severe deficiencies, the huge skill requirement, or how frustrating playing a hunter is in PVP. People have a right to hear the truth, preferably before they have spent months investing in a game or character that isn't what it is being advertised as. If telling people the truth and discussing things openly constitutes "whining" in your eyes you need a serious attitude check.
icepyro Jan 17th 2011 11:44PM
You need to keep writing Disgruntard. Every reply I read is getting less and less QQ and more calm explanation. It's the hyperbole and the insulting the reader that turn others away from you. I agree that I haven't worked out how to effectively PvP and I can't tell if that's the class or me. Maybe hunters are terribad right now. Maybe there is a design flaw. I will say it's taking me more than a few minutes to figure out how to not suck and the class is not faceroll anymore. I'm happy about the latter, though not so much about the former. As I said before, presenting reason and facts are good. It's telling the world that the sky is falling because we suck because the PTR nerfs suck because Blizz needs to listen to me that are bad. That is how some comments come off and that makes me not even really care what is said. This calm concern makes me think you actually care and can tell me what the real deal is. That's comepletely different. I know I have a hard time finding that line myself, but I try and wanted to thank for trying too.
Jidan Jan 17th 2011 6:04PM
Comment fail, previous post was supposed to be a reply to Digruntard's reply to Icepyro =/