Could it be that Australia was an island that criminals were banished to and it comes from the expression being "sent down." Just an idea but it could have stuck
Surely it comes from the fact that if you look at a globe of the world that's where Australia is - down under. And this applies whether you're looking at the globe in Oz or the UK.