People who object to the use of 'me' in these situations do not really understand grammar. Me is emphatic, I is weak when standing alone. Here 'me' is the equivalent of the French 'moi'. The French reply here would be, 'Ni moi' or, more usually, 'Moi aussi'.