I've caught many walleye off the island drifting a spinner rig tipped with a minnow. Don't be afraid to huf the shoreline when doing so. I have noticed in the past couple of years my numbers have increased, but the size has decreased. I just catch and release due to the fishing pressure on the lake. Had some luck tossing spinnerbaits near any rocky shoreline for bass as well. I have not had too many calm days on Chesley, so I can't comment on any topwater presentation.
As far as Silver Lake goes, I grew up having a family cottage on Silver Lake Crescent, and have spent many a days on the water. There is no boat launch on that lake. If you have a small enough boat, say a 12' or 14', you could put it in off of Silver Lake road. We used to take the motor off the 14' and just use the trolling motor. Most of the lake is relatively shallow, in the 2-4 foot range. It is mainly a sand bottom, and I highly recommend you do not fall out of the boat in certain areas of the lake, or you will just sink in the soft bottom. The only fishable areas on that lake is the perimiter, along the entire shoreline. There is bass, pike and sunfish. Being a fairly small lake, we always praticed catch and release. It is along the shoreline that there is any depth to be had. Even then, you might hit 8 feet pending on the water levels.
Good luck, and hope this information is of some help.