You could train your cats to go in their own garden.
As for the threat, I suspect it is bluff, but you could report it to the police. You don't have evidence but they may wish to visit. Or ignore it, but there is obviously a slight risk.
I understand your neighbour's frustration. Owners seem to have no idea what stress and damage their untrained cat causes.