Make sure you have enough length from the BB to the hook. A lot of store bought worm harnesses are less than 2feet long, which to me, is too close to the BB. I actually make 3-5 foot leaders and then attach my 1 foot spinners to the leader. Allows for quick changes and lots of distance. The longer the leader however, the harder it is to land the fish a the boat, so be prepared.
Also, I usually make my spinners with two hooks. Hook the worm once with the first hook, then again once with the trailer. The worm will swing naturally and you'll get a lot less "rip offs".
Enjoy! This is one of my favorite methods for walleye