As said before the bigger the bass the more likely that there offspring will be of a bigger size, also the 1 to 2 pounders are better to eat for taste and health reason.
But all in all the guy should really mind his own business, you didn't do anything wrong so don't worry.
And welcome to the board.