No I don't agree. Despite what some seem to fear, the rate of false accusations is stupendously low. On the other hand, it's pretty clear now that attitudes towards women -- at parties, in the workplace, on the streets, etc -- have been very poor up until recently, and women have had to put up with a great deal more abuse than some seem comfortable acknowledging.
Kavanaugh has certainly lied about his drinking habits; in itself this hardly proves his guilt for the crimes he is accused of, but it's hard to feel sorry for someone who's been as dishonest (and then as bad-tempered) as he has been. Trump, too, must have some guts complaining about this given that he's clearly been involved in less-than-saintly interactions with many of the women in his life.
No, if young rowdy men with "wandering hands" finally get held to account for their disrespectful and lecherous behaviour, so much the better. Why have anything to fear, unless you actually were a sex offender?