I don't really know the laws but I can't imagine that a court would just accept all your husbands demands and ignore your views. They would have to consider what is best for your daughter and would certainly take what you say into as much consideration as what you ex says. If your ex is making unreasonable or unrealistic demands the court won't grant him anything more than what he already has.
I know you hear some horror stories about decisions made by courts regarding parenting but in my experience (my boyfriend has custody of his son and has been to court regarding access for the mother) the courts have been quire fair so far, always taking into account my boyfriends concerns for his son because he is the main carer.
You could go to the citizen advice bureau and see if they can advise you on the legal implications. Hope it gets sorted, perhaps your ex will tire of behaving like a kn0b!