Chris, I find myself in the same boat as you. I have two boys 8 and 2 and a wife that doesn't enjoy fishing, or drinking. My problem is I really enjoy both! When we had Alex I took about 2 years off from serious fishing. Still fished a bit, but focused on the family. Then for about 4 years I got back into it. Got a boat, sled, ice hut, 4 wheeler, etc. Now we have our second son Karter, and she feels I have not given the necessary time to my family. She is constantly on me about fishing and the time I spend on-line, or talking fishing.
To solve the problem, I have learned to ask her for permission first before arranging fishing trips (Rod Caster will agree to this). If she is o.k. with it then I can go. If not, I stay home. She does not feel bad about saying no as I ask her and she answers. Simple. She is not being mean or unreasonable. I have a responsibility to her and my boys that comes before fishing.
Now if I can figure out the social drinking piece, we'll be good.
Family First.....Fishing Seccond
All the best. Fish will still be there in 5 years.