If the trees are planted on his side of the lot line, they are his responsibility to care and maintain. On the lot line, you are jointly responsible.
The sticky bit is when "the neighbours" trees encroach beyond the lot line. You can come to a mutual agreement, or you can go to the municipality to see what the municipality's guidelines are. Some municipalities have a "fence sitting" commitee that does nothing but resolve boundary disagreements.