Also, moment means other things in other contexts. You might look back and consider that a certain event was "the greatest moment of your life" - you couldn't really use "minute" in that context, unless it really was precisely a minute long!
Moment can also convey the meaning of importance, e.g. "virtue is of more moment than security". It also has scientific definitions which have nothing to do with time...