You can't - but you are within your rights to have a cat with Daddy.
Ask him calmly and without accusation, if everything was alright after her last visit - remember, he will be super-sensitive to any suggestion that he is not a fit parent, so tread carefully.
If her reaction persists after another visit, you need to raise the issue again, as a concern, and escalate accordingly.
If he insists nothing is wrong, advise him that she is obviously unsettled by her staop-overs, and if this persists, they will stop.
It may be just a one-off - children at this age don't always react well to changes in surroundings and routine, so don't be too quick to condemn.
That said, your daughter's welfare comes first, and as her mum and primary carer, you have a right to a chat about things, and some answers if things don't improve.