If you don't fish for the table, and only does C&R, it doesn't really matter how they look like. You can hook into big fish and potentially get decent numbers as well within a 15 minutes drive from home. (seeing that you're from Hamilton, I'm actually very jealous of that)
They do fight harder when it's warmer, maybe all the ones you've hooked into so far were caught during the cooler months? If you have a couple of hours to kill, give it another go when it's warmer. Hamilton Harbour houses alot of big fish, there are some 30s in there and even 40s have been caught.