I think you will be OK.
I once saw a 12' boat with 5 or 6 people fishing out of it down there one time.
I seem to recall 2 adults and 4 kids in the boat.
I was standing on the dam at the time.
The water is very cold, make sure you wear your PFD. Cold water will kill you in a hurry.
One April we were fishing the spring tourney down in St. Kitts out of my buddies 36' sportfish in some 4 footers when a distress call came over the radio. A 20'-22' run about had motor issues and had been swamped by a wave. They got lucky as another boat was very close as they didn't have their PFDs on and were just about ready to let go of the boat because of hypothermia. The could swear they were holding on for a long time, when in actual fact the other boat got to them within 30 seconds!!!!!! The next week they were back with shiny new floater coats and suits!!! They were very lucky to survive as the cold will kill you in a heart beat if you are not wearing your PFD!!!! While you will still be very cold with just a PFD on at least you won't be sinking to the bottom with your lungs full of water.
Be safe out there and post pics of the trip.