I agree with everyone here, don't give up with the baitcaster!
Practice, practice, practice! I just got into baitcasters not too long ago and I have learned to fall in love with them!
I'm a Shimano fan boy, I own a Citica and 2 Curados, but for a decent baitcaster closer to your budget I would recommend the Citica.
If you don't want to upgrade in the future and have the money, go for the Curado. It's a little more refined.
However I talked to the staff working at the fishing department, they said the 6 pin brakes are a little more durable than the magnetic brake over a long period of time. But who knows, it comes down to whatever you are comfortable with.
Good luck bud.
-Tinson