Sorry to hear of your difficulties. You have several issues here. I am not an attorney (thank goodness) and can't voice an opinion on legal issues, but here are some considerations as I best know them.
Good luck with your fence, your neighbor and city hall.