So I don't have an AP, so I don't have a stake in this conversation, but I would think that AP holder would not necessarily make the situation any worse. It might make wait times at less popular rides slightly longer, but I would doubt an AP holder would get in a 3+ hour line for ministry or DK. The main reason people are willing to get into these insane lines is because they cannot really come back whenever they want.
I could imagine that if I had an AP, I might do a 20min Monster's line, or even 40min Hiccup, but no way I would spend 3 hours in line for a ride that I can potentially rope drop once or twice a month if I really want to.