We had this problem when we rented a few years back - ours had trhe garden with the alleyway for x4 houses to get to their back gardens. You can't legally block access, but you could make it more difficult to access it whilst drunk to protect your property.
For example - Put on a coded padlock to your gates (of course - give all of your neighbours the code so that legally they still have access, but your tiresome neighbour is unlikely to remember the code when drunk so 'should' get bored trying and go to his front door instead.
Doe's he rent? If so, find out the landlord and make a formal complaint - Council tenant? if so, three complaints from neighbours and they will be moved on.
If they are not renting, report the disturbances to the police - if he is damaging your property - Don't stand for it! Especially if he is abusive when you confront him, the police 'should' provide you with advice and back up.
All the best