I think it's understandable for people in the public eye to be afraid of false allegations. That's all he's saying.
...
Is it though? Is there some sudden spike in them or something? Why does it make sense to be afraid of them, regardless of whether you're in the public eye or not? It's just not something that happens anywhere near enough to be fearful of it whatsoever, and perpetuating the idea that it is is itself the kind of thing that does real harm to women (and male victims) of sexual harassment/assault due to being exactly the type of thing that makes people skeptical about believing victims in the first place.
Just, the question is, why is that shit on his mind in the first place? It happens, yeah, but it's rare, and it's nowhere near as common as actual cases of sexual harassment and assault, so why is it on his mind in the first place, nevermind to the point of it making him hesitant to date period. Like yeah, it's the type of thing that if it did happen, of course it would be terrible, but it's so unlikely that it's like, being afraid of the Yellowstone supervolcano exploding on a day-to-day basis (or if you don't like that, then the idea of the US getting into a nuclear war with North Korea or something). 'Cause yeah, that too would be something that would be terrible if it did happen, but it's very unlikely to happen on any given day so it doesn't make sense to constantly be thinking about it or letting it influence you're life or anything. If it does happen we figure out what to deal about it then, but at any given time when it's incredibly unlikely? Doesn't make much sense. Same deal here--that yeah, it happens, but incredibly rarely, so why would that be on your mind and affecting things like you think it's the other way around and it's some kinda inevitability or something?
So what's understandable about him being so obsessed with something that's so fringe that's nonetheless affecting his thoughts to that extent? And in doing so, whether intentionally or otherwise, naturally raising the questions of well, why does he think that is so common as to be a concern anyway? What exactly does he think about stuff like #MeToo? Is his default that women are just making stuff up and there's actually nothing to those claims? And if not, why is he worried about being the rare exception and actually get false accusations out of nowhere? Why would that ever happen in the first place, and why is that on his mind?
Nothing's understandable about that at all, and it doesn't make much sense at all unless one either has very misguided views of how common that stuff actually is, regarding the nature of #MeToo and those that make sexual harassment/rape claims and the veracity of their stories, if not both.
TL;DR--It's an absolutely ridiculous fear and should be called out as such.