It sounds like they can see your line when they get close to the lure, consider downsizing your lb. test or even going to a flurocarbon... and if you're using braid you may want to consider a leader of changing to mono.
Adapt, improvise, and overcome!