It is illegal not to fill it in. When I used to collect them quite a few people didn't reply or when they answered the door say they are just looking after the house, didn't live there(liars!)
There was not one prosecution the only thing against it is you can't vote and you can't get credit because a elector search is done and will not have you as living at that address.