I won't fish without em. I have really good pairs I wear all the time and alot of cheapos stored in the boat, in the truck, in the tackle box.
It's great when they help see in the water column, but as others have said, it's eye protection. Against the sun, glare and possible incoming lures.
Once you use them there really is no going back