Is there a way to avoid the so called "resort fee"?

Many nicer hotels are getting away with a so called resort fee these days. Basically, this is an additionally daily charge usually between $25 and $70 after the room rate and taxes. I hear roughly the same excuses for this charge nearly every time I ask about it. They typically say something like "This fee covers all the amenities that the resort supplies, such as the pool, tennis courts, turn down service, and in-room wifi." I usually respond "Well, if I don't use those then I don't think I should be charged for them." That has never worked.

Honestly, I don't buy it. Some times I'm already paying well over $250 a night at these places, so it really angers me that there's an additionally daily charge for services I don't even use.

I've never really pressed the issue at the front desk. Would that even be fruitful? Is there a way around this silly (and relatively new*) surcharge?

*As little as 15 years ago this was not very common. It seems to me that it started with the really fancy places (like $500+ per night) about 25 years ago then as trickled down to the lesser hotels. It seems like if they have a pool, wifi, and something like a tennis court, they feel justified in charging for this.