Denver Pop Culture Con (formerly Denver Comic Con) has never struck me as crazy and I've gone to every single one since it began. Granted, some of those were only one-day trips instead of full weekend, but it seemed pretty tame, and it promotes itself as a family-friendly environment with an educational theme. People do show up with their families and young children there. I have heard of there being issues with threats of violence between congoers and sexual harassment, though... I just never personally was a part of any of those situations, but I don't doubt that they happened.
The two big anime conventions have been definitely kind of weird at times -- I've been to NanDesuKon (NDK) and WasabiCon in the state of Colorado before and I stopped going to both because they did end up being kind of the awkward nerd, bad-body-odor kind of experiences that a lot of conventions get knocked for. It also didn't help my experience that I went to both on the encouragement of friends, because I'd been tapped out on anime subculture for a good long time. I liked seeing some of the stuff vendors had at both of them, at least?
I guess it can vary based on the size, the way the convention pitches itself, and of course the attendees. NDK and WasabiCon definitely cater to hardcore anime nerds in Colorado and the extended rocky mountain region; DPCC promotes itself as sort of a pop culture family-friendly cross-section and both generally kind of live up to the way they're pitched.