TD,
I often fish from a canoe. I don't know much about downriggers. I thought they were those heavy cannon ball things that folks use on bigger boats on Lake O etc . I have trouble visualizing how you would use that in a kayak.
I'd be very interested to hear more details re your e-way swivel setup. Don't you still need quite a heavy sinker to get down deep, depending on the speed of course.