It's illegal as soon as so far as I understand it.
It's an offence for your driving licence to have your incorrect address on it so therefore it's an offence the day you move and presumably your application to change it should be "in the post" the next working day.
It would be an offence punishable by points if you were required to produce your licence for any reason and it showed the incorrect address.