If those numbers are accurate, I don't see why you even need the small % of people with ad-blockers to turn them off. You should easily be making enough green to cover your increase in server cost. You said $2,000/year right?
Hell, if you're only charging a third of what the rest of the market is charging for advertising, then why not just charge double what you're charging now and you'd still be undercharging, go get your dedicated server and problem solved? No?
Edit to add: Drop the google ads and use affiliate ads instead. The increase in revenue will more than pay for a dedicated server twice over.