You can walk along the bike path behind the Parliament buildings and fish from shore........your Quebec permit will be sufficient.!!
Smallmouth can also be caught behind the Museum of civilization. There is also a bike path you can walk along.......
Good luck