Whilst an amicable solution is the best way forward, if that isn't possible could you get into their garden through a gate or over a small wall/fence, perhaps while they are out?
I don't see what they could do if you simply let yourself into their garden and carried out the work. The police wouldn't be interested