I think, like any use of language, it's all about context and intent.
You can't generalise about the use of language, it is entirely based on the intention behind its use, so someone using the word 'Doll' in one context may be being affectionate, and another may be being aggressive.
The word is not moveable, but the context and intent always are.